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LIMITS ARE THERAPY 


By RAY H. BIXLER 


MINNESOTA PSYCHIATRIC INSTITUTE 


ESTRICTION of behavior is one of 

the few universal elements in 
therapy. Limits have a role in all treat- 
ment methods, whether the client is 
adult or child, withdrawn or aggressive. 
It may be this very universality which 
accounts for the scanty material avail- 
able in the literature. Obvious differ- 
ences in therapy are sufficiently stimu- 


lating and threatening to hold our at-: 


tention in spite of the fact that problems 
common to all therapies are being re- 
solved at an equally rudimentary level. 
The role of limits on behavior may be 
more important than our current in- 
terest in them would indicate. 


In the play interview the therapist 
will encounter children who refuse to ac- 
cept limits, who kick the therapist, mar 
his wall, and throw his desk calendar on 
the floor in spite of verbalized limits and 
clarified feelings. The literature reveals 
few suggestions for dealing with this 
phase of play therapy. Allen [1] empha- 
sizes the essential role of limits and 
stresses their importance, but omits dis- 
cussion of what he does when limits are 
broken. Axline [2] acknowledges that 
limits are broken. 


Now, what about the child who breaks the 
limitation? Suppose he aims the block at the 


window and, although his feeling is recognized 
and he is told not to throw it there, he does so 
anyway. Usually the recognition of his feeling 
is sufficient to bring down the block; but sup- 
pose this time it doesn’t. The therapist should 
be alert to the possibility that he may not put 
the block down. She should try to prevent the 
throwing of the block if she can do so without 
engaging in a physical battle with the child. 
But if the block should go through the window, 
what then? Should she lecture the child? Put 
him out of the playroom? Or act as though 
she really didn’t care? Such a situation would 
be a real challenge to the therapist. She could 
not temporarily shelve her basic principles. 
She would not reject the child because he dis- 
ebeyed her. She would stay right there with 
her reflection of feelings. “It was important 
to you to throw it anyway. You wanted to 
show me that you would throw it.” [2, pp. 
132-133] 


Again the therapist cannot help but 
wonder what else to do with a child who 
is going to attack him or permanently 
mar furnishings unless there is “physi- 
cal battle.” 

The most effective method for each 
therapist in dealing with limits or any 
other problem he encounters in the in- 
terview is probably that method with 
which he is most comfortable. Believing 
this to be true, there is, nevertheless, 
value in understanding the approach of 
others. This paper is concerned with the 
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theory and practice of limits in therapy 
with children. Special emphasis is placed 
upon the problem of refusal to accept 
limits with accompanying illustrations. 


LIMITS ARE NECESSARY 

Most therapists assume that limits 
are essential. Verbal cxpression and 
much of other behavior may be free of 
regimentation, but the rights, property, 
and physical well-being of others must 
be protected. Some therapists limit 
verbal activity by indirect means, others 
protest against this, but almost all 
therapists set limits upon the range of 
nonverbal activity. 

The obvious value of limits in the 
orderly operation of the clinic is only 
one of several functions that limits may 
serve. The therapist who protects his 
person and property from physical ag- 
gression has an opportunity to feel ac- 
cepting of the child. The potential loss 
of personal possessions or the experi- 
ence of physical discomfort seemingly 
would create pressures which operate 
against real acceptance of the child and 
his attitudes. 

There may be another and even more 
important role in controlling behavior. 
The child who is allowed remarkable 
freedom in most of his activity but is 
rigidly controlled in specific areas seems 
to differentiate between the therapeutic 
experience and other relationships. 
Rather than giving free expression to 
his attitudes at home, school, or church, 
he seems to conform to the accepted 
mores of the environment of the mo- 
ment. This has been observed in inter- 
view and environmental (institutional) 
therapy with amazing regularity. To the 
best of this writer’s knowledge this is 
not equally true of children who are ex- 
periencing a passive therapy (no lim- 
its). This tentative hypothesis would 
seem worthy of further evaluation and 


nay be amenable to clinical research of 
relatively exacting nature. 


LIMITS SHOULD BE MINIMAL IN 
NUMBER 

opinion seems to in- 
dicate a minimal number of limits. If 
the therapist is free to plan his play 
therapy room for that purpose alone 
many limits become unnecessary. The 
presence of a desk with desk set, tele- 


Consensus of 


phone, clock, papers, books, and desk 
drawers necessitates setting of numer- 


ous limits in order to protect property. 
The same is true for overstuffed chairs 
and other pieces of furniture which are 
desirable for adult interviewing. The 
writer found it necessary to set 
limits most frequently on destruction of 
items associated with his desk. This 
condition is undesirable because of the 
1umerous limits it places on the child as 
well as the previously mentioned pres- 
ated in the therapist by poten- 
tial loss of personal possessions. A play 
room such as Axline describes [2, Ch. 3] 
minimizes these dangers without elimi- 
nating the therapeutic functions of 
limits. 


has 


Oc Rr, 
sures Cl 


BASIC LIMITS 


Basic limits set by any therapist will 
tend to differ. In therapy with the 
writer children are not supposed to: 


1. Destroy any property or facilities 
in the room other than play equipment. 

2. Attack the therapist in any physi- 
cal sense. 

3. Stay beyond the time limit of the 
interview. 

4. Remove toys from the play room. 

5. Throw toys or other material out 
of the window. 


In addition to these rigid limits the 
therapist employs some relative limits 
which are invoked rarely and necessi- 
tated by the room in which he works. It 
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is necessary to inhibit noise which inter- 
feres with therapeutic interviews in 
other offices and to keep the child from 
pouring excessive amounts of water on 
the floor, which is not leak proof. An ex- 
ample of the first limit and the only 
time it has been invoked was with a 
group of two children who were push- 
ing a chair and table across the floor. 
Here the limit was invoked by two other 
staff members who found that verbal 
contacts were impossible in their own 
offices. Sound proofing, a first floor 
office, and isolation of the play room 
from other interviewing offices would 
minimize these limits. 


RELATIVE VERSUS RIGID LIMITS 

Wherever possible it seems desirable 
to use well-defined limits. Both the child 
and therapist can achieve greater com- 
fort when confronted with concrete de- 
marcation between acceptable and unac- 
ceptable behavior. Such limits are easier 
to distinguish and are less apt to lead to 
insecurity on the part of the therapist. 
For example, there is a clear distinction 
between hitting the therapist and not 
hitting him, but the vague transition 
point between hitting so as to do no 
harm and hitting to do harm places both 
therapist and child in tenuous positions. 
Wherever degree of activity is a con- 
sideration in setting limits, therapy may 
suffer because the nature of demarca- 
tion is such as to place both child and 
therapist in the position of making de- 
cisions without criteria. It would appear 
preferable to limit a child’s throwing a 
ball at the window, splashing water on 
the therapist, and playing with the 
articles on his desk on an all-or-none 
basis, rather than on a basis of the de- 
gree of harm to person or things in- 
volved. 

No matter how hard one may try, it 
is unlikely that he can remove all rela- 
tive limits. If for no other reason, the 


therapist will see many of his “rigid” 
limits melt before the uncanny ability 
of the maladjusted child. With 
sumate ease he manages to place himself 
squarely on the line of demarcation be- 
tween acceptable and unacceptable be- 
havior. What extent the therapist may 
go in setting rigid limits will be deter- 
mined in part by his own comfort with 
intangible limits. Undoubtedly some 
therapists work more easily with a “You 
can hit me, but not hard,” o 
than does this therapist. 


con- 


entation 


WHEN LIMITS ARE ESTABLISHEI 
There seems to be little or no dis- 
agreement upon the optimal time to 
establish limits. Few therapists t 


, 


limits prior to the child’s : 


fine them. Not until the child threat 
to break a limit is he confronted 
the request that he refrain from so do- 


ine. This avoids a lengthy and incom- 
plete dissertation by the therapist at t 
A prelim 


cussion of limits is apparently more dis- 


onset of treatment. 


. 7 
mary 1c. 
i ‘ 


turbing to therapists than suddenly ec 
fronting the 
tions upon his behavior. 

There seems 
for this point of view. It is impossible 
for the therapist to outline all 
that will have to be set with any child 
before the therapeutic relationship de- 
velops. Even if this were possible, the 
relationship would probably be retarded 
by a “You can do this and that, BUT 
: ” orientation. Furthermore, 
initiative for developing the play ses- 
sions would be taken from the child by 
even the most nonauthoritative thera- 
pist. 

As a result, the child learns what he 
is permitted to do as he explores and 
tests the relationship with the therapist. 
If the latter is oriented primarily to at- 
titudes expressed rather than the con- 
tent of the child’s behavior, any nega- 


child with specific limit: 


to be ample justification 


limits 


the 
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tive potential which could accrue from 
unexpected limitations seems to be mini- 
mized. 


MECHANICS OF SETTING LIMITS 


With experience the therapist devel- 
ops a meaningful system of dealing with 
behavior which exceeds his acceptable 
limits. It seems desirable to graduate 
therapeutic reactions to such behavior. 
The following steps may be used success- 
fully: (1) reflecting the desire or at- 
titude of the child, (2) verbal expres- 
sion of the limit, and finally (3) control 
by physical means of the child’s be- 
havior. For example, a child might be 
angry at the therapist and want to hit 
him because the therapist will not let 
the child take a doll home with him. The 
gradation of limits might take place in 
some manner similar to the following 
hypothetical example. 


Therapist (1): You’re mad at me because I 
won’t let you take the dolly. You want to hit 
me because you’re mad. (To many children 
this is sufficient. Acceptance of their desire 
seems to eliminate need for the act itself.) 

Child (1): (Hits at therapist, who wards off 
blow if possible.) 

Therapist (2): You’re awfully mad at me 
and want to hurt me. It’s all right to be mad 
at me but you’re not supposed to hit me. (The 
vast majority of children stop at this point.) 

Child (2): (Tries to kick or hit therapist, 
who tries to protect self.) 

Therapist (3): If you hit me again you’ll 
have to leave the room for today. You want 
to hurt me because you’re awfully mad at me. 
If you do hit me you'll have to leave for today. 

Child (3): (Hits at therapist again. When 
limits reach the stage of Therapist (3) for the 
first time, the child almost always challenges 
this limit. In ensuing interviews it rarely hap- 
pens that he will do so again.) 

Therapist (3): You’ll have to leave for to- 
day, John. (Stands up and opens door.) I'll 
see you next week—you’re awfully mad at me 
because I won’t let you do some of the things 
you want to do. 


1Warning the child that he may be removed 
from the office may seem like threatening him. 
There seems to be a very real and clear-cut 


At this point the child almost always 
leaves the room. Only two times in five 
years has the writer been forced into 
picking the child up and placing him 
outside the room. Several children, one 
of whom is discussed later (Marvin), 
have continued their attacks in the outer 
office to the point where it has been nec- 
essary to hold them at arm’s length. 

Perhaps the most significant factor in 
maintaining the all important thera- 
peutic attitude of acceptance is simply 
that the therapist receives very little 
punishment and the time involved is not 
excessive. Under these conditions it is 
quite possible to feel acceptance of the 
child and his attitudes while rejecting 
a phase of his behavior. If the therapist 
were to be under the influence of con- 
tinual attack over a period of time in 
one interview, he would have to be a 
very strong personality to keep from re- 
jecting the child and behaving in a 
punitive manner. Even if this were pos- 
sible it seems undesirable to allow bro- 
ken limits, especially where they involve 
antisocial acts. 

The fact that children frequently 
leave the office with a sense of relief 
when involved in the third stage of 
limitations lends credence to the gener- 
ally held belief that children do want to 
have their agressive behavior controlled. 
This is further substantiated by ac- 
companying positive changes in the 
child’s behavior at home and in his re- 
spect for limits in therapy. Clinical ex- 
perience seems to indicate that rigid ad- 
herence to behavioral limits accompani- 








distinction between threatening and the proce- 
dure suggested here. The therapist is not 
punitive in attitude and he carries out exactly 
what he says he will do. When he fails to in- 
voke this limit he actually invites more aggres- 
sive antisocial acts. The writer is indebted to 
Virginia H. Bixler, Director of the Vince A. 
Day Center, for considerable help in clarifying 
the role of limits in therapy. Opportunity to 
observe group treatment of aggressive children 
at the Center has played a major role in the 
development of this thesis. 
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ed by an acceptance of the attitudes 
which motivate this behavior serves as 
the crux of therapy with many aggres- 
sive children. 


CASES OF PAT AND MARVIN 


The following excerpts were taken 
from play therapy contacts the writer 
has had with very aggressive children. 
They were selected because therapy was 
“mussy” in spots, thus highlighting the 
effectiveness of sound limits when they 
were invoked and because they illustrate 
many of the extreme problems involved 
in setting limits. 

The first is the case of Patrick Mori- 
arity, ten years old. He was referred to 
M. P. I. because of uncontrolled aggres- 
sion in and out of the classroom. He had 
been expelled from school. In his initial 
contacts (the record starts with the 
fifth interview) his aggression was 
verbal or directed at the toys. In order 
to partially compensate for the lack of 
verbatim notes, comments regarding the 
process of setting limits are added. 


5-9-47 Pat was very mad at me. He came 
in and kicked the ball and then with a gleam 
in his eyes looked around the room. He made 
several comments about the use of various ob- 
jects in the room as weapons to be used against 
me. I mentioned that he was awfully mad at 
me and thinking up a number of ideas that 
would hurt me. He acknowledged this. Short- 
ly after this it was necessary to limit his at- 
tempt to pour water on the calendar. He spent 
most of his time today trying to make me mad 
in one way or another, although it was occa- 
sionally interspersed with friendly discussion. 
He pinched my nose at one point and hit me 
at another. 


It is apparent that Pat broke several 
limits in this interview. The therapist 
recognized his hostility and set the 
limits, but other than defending himself 
in a physical sense did not invoke limits 
to make Pat stop his aggression. It may 
have been desirable to have set and in- 
voked the limit of leaving the office. 


5-13-47 He started out again today to try 
to make me mad. First he threw the nipple 
out of the window, then poured the water out 
of the nursing bottle. He started to pour it on 
the table. I limited him. This intensified his 
trying to make me mad. He got very angry 
at me because I didn’t get mad, but all during 
this he readily accepted the limits that I set. 
When I told him it was time to clean up, he 
made a few moves to do so but did not finish. 
He asked me what I would do if he didn’t 
clean up. I told him that that was something 
I would have to clean up after he left if he 
didn’t do it. That made him quite happy and 
I recognized his joy at my having to clean up 
the messes he made. 

5-16-47 In the initial part of the period to 
day there was a marked change in Pat’s be- 
havior. It was largely constructive. He talked 
about, instead of demonstrating, his 
siveness. After awhile, however, he took the 
nipple off the bottle, threatened to throw it out 
and I set a limit on him at this point. He then 
threw the pegs on the floor. After thi 
he started to play and talk in a friendly, con- 
structive way. I mentioned that 
was mad and wanted to make me mad, and 
sometimes he wanted to play and talk with n 
During the rest of the period his ar 
increased, but at no time today did it approach 
what it has been in the past. This is somew! 
difficult to evaluate at this stage in therapy. 


aggres- 


‘ D or de 


son mes he 


tacnr 
avo srr 


The therapist is obviously confused. 
Speculation about the significance of an 
attitude of confusion on the part of the 
therapist leads to the question, “Is what 
ensues in later contacts a result only of 
the child’s maladjustment or does the 
therapist, because of his own uncertain- 
ty, create a subtle stimulus pattern 
which intensifies the youngster’s reac- 

os 


tions? 


5-20-47 Pat was very angry. As he came 


threw himself around in the room when he 
came in. He took the nursing bottle and tried 
to break it. His attempts to break it were not 
very wholehearted at first, pounding it against 
the radiator easily for quite a period of time. 
I recognized that he wanted to break it and 
yet in some ways was a little afraid to do so. 
At this point he broke it. I said, “You wanted 
to show me that you weren’t afraid. You also 
wanted very much to make me mad.” He was 
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pretty upset about breaking it. I recognized 
this and told him that he was supposed to clean 
it up. He began to do so and did quite a bit 
of the cleaning up. He got angry with me, 
however, much more so at this point when I 
didn’t get mad because he broke the bottle. 
He was very hostile and spun my chair around. 
He quieted down. He asked about my writing 
and I told him. This upset him, too, and he 
didn’t believe it. I recognized his feeling that 
I probably was giving it to other people to 
read. He went to the table, turned his back 
to me, and spent a long time there, growling. 
He turned to me and said, “Why do you write 
to yourself?” I said, “You don’t believe I write 
these things just for myself—you feel pretty 
sure that I give them to somebody else to read.” 
He responded, “Yeah, I bet you do.” He talked 
about eating me up and other savory forms of 
getting rid of me. I mentioned that he was 
awfully mad at me and wished he could get 
rid of me, that he was pretty unhappy because 
I didn’t let him do some of the things he 
wanted to do. At this point he came over and 
hit me. The time was about up and I told him 
it was time to clean up the water on the floor, 
and he asked me what I would do if he didn’t. 
I told him, “Nothing.” He said, “Who would 
clean it up?” I said, “I would.” He threw the 
rag on the floor. I mentioned that it was a lot 
of fun to think that I would be the one who 
would have to clean up any mess that he left. 
He was pleased by this and then gradually 
became more angry again—apparently because 
I didn’t get angry. 


Note the intense frustration Pat ex- 
periences in his relationship with the 
therapist. This may be due to Pat’s in- 
ability to control the therapist’s emo- 
tional reactions and to the therapist’s 
fuzzy reaction to Pat’s struggle with 
limits. 


5-23-47 Pat checked on the things he had 
done last time to see if they were still the way 
they were and looked outside to see if the nip- 
ple was there and at the back of the doll to 
see if it were still broken. He played quietly 
at the sink for awhile, then he came over to 
me and hit me on the head. I limited this be- 
havior and mentioned that he was still pretty 
angry at me. He went over to the sink again 
where he played for quite awhile — then he 
came to me for help with opening the gun. I 
mentioned that he was having a lot of fun 
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playing. He was very intent on his work and 
a moment later I mentioned that sometimes he 
liked to do things to make me mad and other 
times he just liked to play. He played a little 
while longer and then came over and tried to 
throw water on me. When I limited him he 
returned and dropped the gun behind the radia- 
tor. He played quietly for quite awhile. It was 
apparent that he was trying to destroy the 
doll. He was trying to tear or hurt it and 
when I recognized this at the time when our 
time was just about up he suddenly flew into 
a very intense rage and attacked me. He has 
become more and more frustrated because he 
has been unable to make me mad. 


Note that the therapist seems to feel 
that Pat’s frustration is due solely to 
his inability to anger the therapist. 

5-29-47 Pat came into the room and imme- 
diately became aggressive. He tried to destroy 
the doll and was unable to. He poured water 
on the floor from the nursing bottle and when 
he began to fill it up the second time to throw 
it on the floor, I told him that he could throw 
two bottles of water on the floor but no more; 
that if he poured more, he would have to leave 
the room. He dumped the second bottle and 
immediately filled it up and started to pour a 
third. He left readily when I invoked the limit. 


This seems long overdue. Invoking of 
the limit was consumated while the 
therapist was still calm and able to ac- 
cept Pat’s attitudes. In the next inter- 
view Pat’s mother reported marked im- 
provement for the first time. 


6-4-47 Pat refused to come in and hung 
around the door for ten or fifteen minutes. As 
soon as he came in he threw the ball out of the 
window. I warned him and then he threw a 
doll out and I sent him from the room again. 


Again the limit was invoked quickly. 
This approach to therapy appears to be 
far removed from what is considered 
good counseling. Ensuing interviews 
and the change in behavior reported by 
Pat’s mother would indicate that thera- 
py is taking place. 


6-11-47 He was mad today. He didn’t know 
why or at whom and was able to say so. He 
spent most of his time talking in a friendly 
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way with me. There were only two mildly ag- 
gressive acts during the period. He worked 
awfully hard to be good during the period and 
I recognized this. I said that in many ways 
he wanted to be good and it was pretty hard 
to be good. This is encouraging in light of the 
improvement that has taken place outside of 
interviews. It may be an indication that we 
are drawing near a close in this treatment 
situation. 


The improvement noted at home ap- 
pears for the first time in the play inter- 
views. This is not a dramatic example 
of the role of limits in therapy, rather 
it is typical. The child as weil as the 
adult receives much security from ex- 
ternal control of his antisocial acts. 


6-20-47 Pat was much better today. His only 
aggressive act during the whole period was to 
tear my blotter and drop it on the floor. I 
asked him when he thought he would want to 
stop coming to see me and he was not able to 
answer this question at this point, saying, “I 
don’t know.” 


Since this interview there has been 
no significant trouble at school or at 
home. Visiting teachers report that his 
behavior is exemplary. His mother cal- 
led up the first week of school this fall 
because the principal did not want to 
admit him. He has been admitted and is 
a “changed boy.” Undoubtedly more 
forthright limits in the earlier contacts 
would have brought this change about 
sooner. At this date, May, 1948, he still 
retains this level of adjustment. 


6-27-47 Today Pat was very constructive in 
his behavior. No aggressive acts toward me 
were apparent. He expressed some feeling 
about coming in, and I brought up the ques- 
tion of whether or not he wanted to continue. 
He thought at first he would like to come in 
three times, then he changed it to one time 
and finally to two times. He and I went in 
and spoke to Mrs. Wood and his mother about 
it and they decided they would come in for two 
half-hour appointments. 


7-11-47 Pat was somewhat uncomfortable to- 
day and I brought up the fact that he would 
be seeing me one more time and he growled 
“Yeah.” I said, “Maybe you would be happier 


if this were the last time.” He looked at me 
and smiled and said, “Yes.” So I called Mrs. 
Wood to see if it would be possible to make it 
the last time as far as Pat’s mother was con- 
cerned. She felt it would be and I told Pat, 
who felt very good about this. There was no 
evidence of hostility today. He was somewhat 
troubled, found it a little difficult to break with 
me, but at the same time maintained the im- 
provement that he has demonstrated in the last 
few interviews. 


Marvin was five years old. His aggres- 
sive and infantile behavior had caused a 
nursery school and later a kindergarten 
to expel him. He threw numerous tem- 
per tantrums, especially in public places. 
He was very fearful and used his fear 
to control his mother. Several contacts 
had preceded the first described here. 
These had been in the presence of his 
mother. (Fearful children usually can 
give up their parents in one or two in- 
terviews. By letting parents come with 
the child if he so desires the trauma of 
separation is avoided by starting at the 
level which is feasible for the child. 
Marvin was unable to make this tran- 
sition. An intermediate stage was initi- 
ated to let his mother see a psychiatric 
social worker. He was told he could come 
in to see me if he desired.) 

2-19-47 As soon as I to the 
room, Marvin shouted, “I’m not 
that old stinker Bixler.” I l, “You’re not 
going to have anything to do with me. You’re 
awfully mad at me.” He did not come into my 


came walt 4 
going with 


said 


office at all during the period, but as they got 
ready to leave I came out and he started call- 
ing me all sorts of names. This was more in 
a teasing rather than angry fashion and I 


mentioned that sometimes he got awfully mad 
at me and wanted to call me names, and at 
other times it was fun to tease me by calling 
me names. He continued this for some time, 
calling me an old stinker, a pooh-pooh, a Mr. 
Grease, and other names. Twice he kicked my 
foot and several times made as if to hit or 
kick me on the shin. After I went back to my 
office he came back to it twice, stuck his head 
around, and yelled that I was an old stinker. 
The second time I said “Hi,” and he shouted 
“Mind your own business.” After he was fully 
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dressed to leave, he and his mother came back 
because he wanted to say good-bye to me. He 
stepped completely into the office and said 
“Good-bye, you old mind-your-own business,” 
and shouted as he went down the hall that I 
was an old pooh-pooh. 


Setting and controlling limits in an 
outer office is difficult. Where a child 
continues his attack it would usually 
seem better to separate from him at the 
door of the play therapy room. 


3-4-47 Last week Marvin refused to come to 
the room and called me names when I was in 
the waiting room, expressing this more in a 
mingled anger and teasing than pure anger. 
About midway through our period I came out 
and told him that if he would like to come into 
the office he could come. Otherwise I was going 
down for coffee. He said he didn’t want to see 
me so I went on out. He did apparently come 
to the office later on while I was out and was 
disappointed. His mother had told me at the 
initial part of the contact that Marvin was 
very anxious to come today. 

Contact on 3-4-47: When I went out to get 
Marvin he shouted, “I’m not going in your of- 
fice today.” He called me an “old stinker” and 
several other names. I mentioned that he was 
awfully mad at me and didn’t want to have 
anything to do with me; that he could come 
down later if he wanted to and I would be in 
the room. As I went to the office he followed 
me a short distance and stopped short of the 
door. He then came to the door, peeked around 
it, and screamed at the top of his voice. I 
mentioned that he was afraid to come in, yet 
he wanted to come in — he couldn’t decide 
whether to do so or not. He rushed out of the 
room again. He returned to the door, screamed 
in anger, came in and pounded on the peg 
board. He hit my foot at this point. I men- 
tioned that he was afraid of me and mad at 
me, but that he must not hit me. He went 
back and hit the pounding board some more. 
I mentioned that he was awfully afraid and 
mad and when he was like that he felt like 
making a lot of noise. He rushed out of the 
room again into Mrs. Wood’s (psychiatric so- 
cial worker) office, then out of there and back 
very quickly. He started to pound, looked at 
me, expressing both anger and fear, which I 
recognized. “You B.M.”, he shouted. “When 
you’re mad at me you feel like calling me 
names.” “You ham. I'll smash you in the 
jaw.” I mentioned that he was awfully mad at 


me and would like to hurt me, and yet he was 
afraid of me, too. He pounded on the peg 
board and counted in a shout “1, 2, 3,” and so 
on up to 10. I mentioned that it helped to make 
a lot of noise when he felt like he did. Se said, 
“Shut up. None of your business,” and rushed 
over and hit me. I again limited him. 

He went to the chair on the other side of 
the room and said, “I can hit you if I want 
to.” I mentioned that he wanted to hit me and 
yet was afraid of me. He came over and 
swung the mallet very close to my face and I 
jumped. He smiled. I mentioned that it was 
fun to scare me and that he was glad he could 
do it. He threatened time and time again to 
hit me at this point. I recognized his desire 
to scare me and at one point mentioned that 
he was afraid of me and wanted to make me 
afraid of him. He called me a snot, and then 
“You little snot.” “You’re mad at me and like 
to call me names because you’d like to have 
me get mad at you.” He then rushed over and 
kicked me and rushed out of the room again. 
He returned very shortly and continued threat- 
ening me with the mallet. These threats were 
handled again by recognition of the anger and 
fear he felt. 

The time was about up and I told him. “I’m 
glad it is.” He asked me several questions at 
this point about the toys and then returned to 
his pounding, saying without any provocation, 
“Mind your own business, you old snot.” I 
mentioned that he was awfully angry at me be- 
cause I talked to him, and at times he got an- 
gry because I didn’t. “You little snot. If you 
don’t keep quiet, you little do-something, I'll 
crack your head open.” When the time was 
up he found it very hard to leave the room. 


Note that, as in Pat’s case, the thera- 
pist allows limits on aggressive behavi- 
or to be broken time and time again 
without removing the child from the 
room. 


The mother broke off contacts. A peri- 
od of six and one half months elapsed. 
His mother returned two weeks before 
school started because she was afraid he 
would be expelled from school. She 
wanted him straightened out “in time 
for school.” In order to be of as much 
help as possible, Marvin was seen daily 
for two weeks and three times the first 
week of school. His fear of the play 
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situation made it impossible at first for 
him to come to the room without his 
mother. 


8-20-47 Marvin was full of intense hostility. 
He would come into the room only because his 
mother came with him, threw water around the 
room, and very shortly after he came into the 
room I kad set several limits and finally had 
to tell him if he didn’t stop throwing water on 
the floor I would have to send him out. He 
continued and I sent him out. 


Maybe the therapist has learned 
something from his previous experience. 


8-21-47 Marvin came in and spent the first 
part of the period having his mother read out 
of a comic book; then he played for a while. 
His play was very aggressive as it had been 
in the previous interview, throwing the water, 
etc. When I set limits about having to leave 
the room if he continued, he stopped. There 
was much less antagonism today, but the an- 
tagonism was intense. 


Note the rapidity with which Marvin 
has altered his reaction to limits. 


Summary 8-22-47 through 9-5-47: Marvin 
continued his aggressiveness through this pe- 
riod, though there have been marked changes 
for the better. During the next seven inter- 
views he was able to come to my office only 
once by himself — that was a day when his 
mother had an appointment with Mrs. Wood. 
The last three interviews he has been able to 
come in by himself and play. In this period 
he was excluded from the room several times 
because of failure to meet limits, but this has 
diminished so that the play is much less ag- 
gressive and he meets limits much better. He 
continued to throw water around the room sev- 
eral times and to destroy things on my desk. 
This, too, has diminished considerably. During 
the last three interviews much of the time has 
been spent in play, rather than expressing hos- 
tility toward me. His attitude has changed 
from one of complete hostility to a very ambi- 
valent attitude toward me, coming close to me 
many times, talking to me about things, even 
playing with me and asking me to do things 
for him. I notified him that I was going on 
vacation and that we would see each other 
three more times, and kept that up through 
this period. 

The day of the last interview, near the end 
of it, he said, “Please call my Mommy and ask 


if 1 can’t go to her, or if she won’t come to 
me.” He was very upset and I called her and 
arrangements were made. During the last 
three days it was not necessary to lock the 
door of the room in which his mother was in 
order to keep him out. At first when he sep- 
arated himself from his mother he would run 
two or three times to see her, to see if she was 
there, and then return to me. ‘‘he last few 
days he has been able to stay away from the 
room and not run to her, the last day being the 
only exception and at this point instead of run- 
ning to her he asked me to get her. At the 
conclusion of each interview he has tried to 
kick me. At the conclusion of the final inter- 
view on September 5 he kicked me twice, and 
the second time it was with sufficient vigor so 
that it hurt me. He kicked at me again. This 
time I threw my foot up to protect my shin 
and he kicked his shin against my heavy shoe, 
which put a large scratch on his leg. It hurt 
him considerably and threw him into a temper 
tantrum. Considering the fact that this was 
the end of our interviews for a period of time, 
it seemed most desirable to be with him as he 
worked through this temper tantrum. After 
all, he was not seeing me for three weeks and 
I had just hurt him, which might give him a 
real basis for feeling rejected. The temper tan- 
trum took place in Mrs. Wood’s office, where 
he screamed and yelled and threw himself 
around. He wanted me to leave the office and 
was very insistent that I would. I recognized 
his feelings and worked with him on this. 
Gradually the temper tantrum receded and he 
began to get control of himself. There 
a few sporadic outbursts after the first one, 
but they, too, diminished; and finally with a 
grin on his face he said, “I am going down to 
his office and pull his chair out of the room.” 
This had been a limit which had been set in 
the interview and was one way of getting even 
with me.. I recognized this desire and he 
rushed down to the office, pulled the chair 
out, put it back in, and for the next two or 
three minutes he tried to struggle to take the 
chair out of the office. I mentioned 
made him happy to try to get even with me, 
that he was awfully disappointed and unhappy 
because I had hurt him and he wanted to get 
back at me because of that. He seemed to be 
in good control of himself when he left and 
seemed to have worked out much of it. He was 
quite unhappy and sad. He was terribly sad 
because I was leaving and was awfully mad 
and unhappy because I had hurt him; yet 
much of the extreme tension around it had 
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been relaxed and he was in much better con- 
trol of himself. 


The improvement in Marvin’s behavi- 
or is faltering but marked. Marvin had 
actually “drawn blood” in two spots on 
the therapist’s shin bones. Had the 
therapist and child separated at the 
office door, Marvin’s injury as well as 
the punishment the therapist took could 
have been avoided. Marvin made a very 
good adjustment to school. The only 
complaint was that he did not sing when 
the other children sang. Six weeks 
elapsed between this and the following 
interview. 


10-15-47 Marvin has made almost unbeliev- 
able progress. The first twenty minutes it was 
not necessary to set any limits. He was quite 
unhappy. I recognized this and he agreed to 
it. He gradually changed his unhappiness to 
anger and in the extremes of his anger ex- 
pressed it by pounding very hard on the pound- 
ing board and screaming and yelling. He be- 
came exceedingly wild but remained within the 
limits of the situation, never attacking me or 
the permanent fixtures of the room during this 
period. His words became unintelligible as he 
shouted and screamed and pounded. Suddenly 
he stopped and took the nursing bottle. He be- 
gan to squirt some on the floor and the wall and 
the windows, then he took the ball and threw 
it hard. I mentioned that he was awfully an- 
gry and that it made him feel good to be able 
to pound and yell and throw things. At this 
point his play took on an even more construc- 
tive aspect and he returned to his pounding 
without the previous fervor. I mentioned that 
sometimes when he was mad he tried to hurt 
other people and make them mad and other 
times he just pounded and yelled when he was 
mad. He pounded a little bit and then became 
quite quiet during the rest of the period, play- 
ing without any expression of hostility whatso- 
ever. I wouldn’t be surprised but that we are 
beginning to reach the conclusion of treatment. 


Here we begin to see the closing 
phases of treatment. Marvin’s mother 
again stopped treatment at this point. 
He maintained this level of adjustment 
until the end of the school strike in 
March, 1948. Apparently the school pro- 


vided some support. His mother and 
father are seriously maladjusted and the 
mother made very little progress. She 
has now returned for treatment and the 
therapist’s relationship with Marvin is 
again very shaky. 


LIMITS WITH ADULTS 


The reaction of children to limits, al- 
though better known and understood, is 
in all likelihood no different than that 
of adults. The staff at the Minnesota 
Psychiatric Institute have been trying 
to evaluate (clinically) the potential role 
of limits with adults. Although the 
number of cases is small and the experi- 
ence too limited to be more than pro- 
vocative, it would appear that limits 
may have a significant therapeutic role 
with: 


1. Hysterical clients who “faint,” or 
engage in other histrionics so as to in- 
terfere with the efficiency of the office. 
(Restriction of such behavior or discon- 
tinuance of contacts.) 


2. Clients who seek treatment from 
numerous staff members, including sec- 
retaries, at odd moments and between 
scheduled appointments. (Setting of 
limit to relationship with one staff mem- 
ber.) 


3. Clients who fail to make progress 
over a period of several months but 
tenaciously continue contacts. (Setting 
limit to the remaining number of ap- 
pointments. We have used a limit of ten 
or fifteen more interviews. Results have 
been very encouraging and would sug- 
gest experimentation on a much wider 
basis. ) 


CONCLUSION 


The use of limits with adults and 
children seem to be most effective when 
the therapist’s attitude is nonpunitive. 
It is possible to be accepting of the 
client’s feeling or need to commit anti- 
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social acts without permitting him to 
carry these feelings into action within 
the interview. Limits within a punitive 
structure apparently inhibit rather than 
reorient behavior. 

The experiences related here indicate 
that limits may be of greater thera- 
peutic value than our current interest 
implies. 


SUMMARY 


The value of limits in therapy has 
been minimized in the current directive- 
nondirective arguments. The therapist 
may find that the more precise his 
limits and the more quickly they are in- 
voked, the easier it is for him to use 
them therapeutically. That limits are 


therapeutic is illustrated by two ex- 
amples with very aggressive children. 
It may be that the use of limits on be- 
havior in therapy is equally as impor- 
tant as acceptance of the attitudes 
which provoke behavior. 
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THE RELATIVE EFFECT UPON PROJECTIVE RESPONSES 
OF STIMULI REFERRING TO THE SUBJECT AND OF 
STIMULI REFERRING TO OTHER PERSONS' 


By JOSEPH M. SACKS 


VETERANS ADMINISTRATION, NEW YORK CITY 


HIS study is concerned with the 

problem of determining the rela- 
tive effect upon projective responses of: 
(A) Stimuli which refer directly to the 
subject, and (B) Stimuli which refer to 
persons other than the subject. The 
stimuli used in this study are sentence- 
completion items. 

The object of the study is to investi- 
gate the validity of the assumption, 
widely held by those who construct and 
employ projective techniques, that the 
subject reveals more about himself when 
he is talking about other people or about 
impersonal, unstructured objects, than 
when he is talking about himself. 

The problem is based upon the hy- 
pothesis that the responses of individu- 
als to the two types of stimuli described 
above (A and B) will differ significantly 
in terms of the amount of disturbance 
revealed in the areas of personality to 
be studied ; or the types of problems and 
attitudes revealed. 


BACKGROUND AND NEED FOR THE 
STUDY 


The Sentence Completion Test 
One of the pioneer workers with the 
sentence completion method in the field 


1Abstract of a thesis submitted to the Gradu- 
ate School of New York University in partial 
fulfillment of the requirements for the degree 
of Doctor of Philosophy. Published with the 
permission of the Chief Medical Director, De- 
partment of Medicine and Surgery, Veterans 
Administration, who assumes no responsibility 
for the opinions expressed or conclusions drawn 
by the author. 
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of personality was Tendler [13] who 
distinguished between diagnosis of 
thought reactions and of emotional re- 
sponsiveness. The items of his test were 
intended to stimulate admiration, anger, 
love, happiness, etc. Tendler believed 
that the presentation of stimuli in the 
form of incomplete sentences would 
arouse a particular emotional set and 
yet allow for free responses. In analyz- 
ing the responses of 250 college girls, 
Tendler noted that: the same stimulus 
evokes different responses from differ- 
ent individuals; individuals differ in the 
associative flow of responses; responses 
indicate fears, aversions, likes, interests 
and attachments; they may have posi- 
tive or negative ego-reference or social 
reference. 

Rohde advocated use of the SCT asa 
tool for clinical psychologists and other 
professional people who deal with youth 
problems. Direct questioning tends, she 
maintained, to make the individual self- 
conscious and puts him on the defensive. 
Freedom of expression is limited in that 
the questions usually control the an- 
swers; but projective techniques avoid 
such resistance or control. They reveal 
latent needs, sentiments, attitudes and 
aspirations which the subject would be 
unwilling or unable to recognize or to 
express in direct communication. “The 
sentence completion device in which the 
subject is asked to read to himself the 
forepart of a sentence is essentially a 
projection technique utilizing free as- 
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sociation.” [7, p. 175]. 

In Shor’s Self-Idea-Completion test 
(SIC), the 50 items “are arranged in a 
definite sequence to permit a carry-over 
or generalization of attitude from im- 
mediate to basic human interest” [9, p. 
280]. The author emphasizes the im- 
portahce of adapting stimuli to the cur- 
rent situation and cultural background 
of the groups tested. Shor suggests that 
administration be adapted to the dy- 
namics of each case. An actively anxious 
patient, for example, might release rich 
material by the oral method while an- 
other patient might be able to express 
himself better if left alone to write the 
responses. No formal scoring system is 
offered but Shor recommends investi- 
gating areas of rejection, evidences of 
resistance, and other methods of eva- 
sion, noting recurrent themes and atypi- 
cal associations, and evaluating the level 
of personality projected. 

Stein [11] described a sentence com- 
pletion test which was originally de- 
veloped as an aid in the selection of 
OSS personnel during the war. Items 
were selected to contribute relevant in- 
formation concerning at least one of ten 
areas considered important for person- 
ality evaluation: family, past, drives, 
inner states, goals, cathexes, energy, 
time perspective, reaction to others, and 
reaction of others to the subject. In this 
test, for the first time, two different 
types of items were used: the more 
“projective” questions in which the 
proper name of some person or the 
third personal pronoun is employed, 
and personal questions in which the 
first person is used. The two types were 
mixed in random order. 

Symonds has reported on _ studies 
using this type of test in the OSS assess- 
ment program. Comparisons were made 
between the test responses of candidates 
and data from OSS records. It was 
tentatively concluded that “the sentence 


completion test cannot be used to differ- 
entiate good and bad adjustment by any 
direct comparison of items or by psy- 
chometric methods. The sentence com- 
pletion test is descriptive and not evalu- 
ative” [12, p. 321]. 

On the other hand, Rotter and Willer- 
man [8] claimed fairly high validity for 
the sentence completion method as an 
evaluative technique. The validity of 
their Incomplete Sentence Test, used in 
AAF Hospitals, was determined by cor- 
relating the psychologist’s initial evalu- 
ation of the severity of each patient’s 
disturbance with the patient’s total 
score on the test. 

Carter [1] combined a modification 
of Tendler’s Emotional Insight Test 
with a psychogalvanometer to investi- 
gate certain affective processes. He 
found that changes in palmar skin con- 
ductivity and reaction time were signi- 
ficantly greater in individuals with 
problems and in psychoneurotics than 
in normals. However, the oral responses 
of the control and experimental groups 
varied little. 


Studies Concerned With Reference to 
the Self and to Others 


If it can be demonstrated through the 
medium of the SCT that the individual 
reveals more about himself when he is 
talking about other people in his projec- 
tive-responses than when he is talking 
about himself, such a finding could be 
applied to the construction of this spe- 
cific type of test. In a broader sense, it 
would suggest that a survey be made of 
other techniques of personality evalua- 
tion which depend largely on what the 
individual says about himself, i.e. case 
histories, autobiographies, and person- 
ality inventories, to see whether greater 
emphasis should be put on semistructur- 
ed questions dealing with the subject’s 
attitudes toward other people. On the 
other hand, if it can be clearly demon- 
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strated that the individual reveals more 
when he is speaking about himself, fol- 
low-up studies in other projective tech- 
niques like the Rorschach, Thematic Ap- 
perception Test, and Picture Frustra- 
tion Study would be indicated. 


Such an investigation has already 
been made with regard to direct and in- 
direct forms of a personality question- 
naire by Ellis [3]. Significant differ- 
ences between the average scores of 
problem and nonproblem children were 
_ found only for one of the direct forms. 
Moreover, the direct forms contained 
more items discriminating between the 
two groups than did the indirect forms. 

Spencer [10] administered the Ex- 
perience Appraisal Blank to a group of 
192 high school students who were in- 
structed not to sign their names and 
were assured that their responses would 
be kept confidential because their identi- 
ties would not be known. About 22 per- 
cent of the subjects said they would 
have left some of the questions un- 
answered if their signatures had been 
requested, and about nine percent said 
they would have answered some of the 
questions untruthfully. The latter had 
the highest average conflict scores while 
those who said they would have willing- 
ly answered all questions truthfully had 
the lowest average conflict scores in the 
entire group. 

Combs [2] made an analysis of mate- 
rial produced in autobiographies and in 
TAT stories of the same subject. He 
found that subjects tend to express 
more socially acceptable attitudes and 
feelings in the autobiographies, and 
more aggressive, “prohibited” attitudes 
and feelings in the TAT stories. 


METHODOLOGY 


Four areas of personality were arbi- 
trarily selected for study based upon the 
findings from various personality in- 
ventories, indices, and projective meth- 


ods. These areas were Family Attitudes, 
Sex Attitudes, Interpersonal Attitudes, 
and Self-Attitudes. The first area was 
divided into three categories: attitude 
toward mother, attitude toward father, 
and attitude toward family unit. The 
second area was divided into two cate- 
gories: attitude toward women and at- 
titude toward heterosexual relation- 
ships. The third area was divided into 
four categories: attitude toward friends 
and acquaintances, attitude toward su- 
periors at work or school, attitude 
toward people supervised, and attitude 
toward colleagues at work or school. The 
fourth area was divided into six cate- 
gories: fears, guilt feelings, attitude 
toward own abilities, attitude toward 
past, attitude toward future, and goals. 

The SCT used in this experiment was 
constructed in the following manner: 
20 staff psychologists of the Veterans 
Administration New York Regional Of- 
fice Mental Hygiene Service were re- 
quested to submit three test items for 
each of the above 15 categories. These 
items were assembled and to them were 
added other items obtained from previ- 
ous SCT studies. This list of 280 items, 
ranging from 14 to 26 items per cate- 
gory, was submitted to the same group 
of 20 psychologists who were then re- 
quested to select the four items in each 
category which they believed best suited 
to elicit the subject’s attitudes in that 
category. In each category the four 
items most frequently chosen became 
the test items. The 60 items were print- 
ed in such order that each category was 
represented once in the first 15 ques- 
tions. The same order of categories was 
followed in each group. Two forms of 
the test were used: In Form A, all of 
the items were worded in the first per- 
son. In Form B, a form of the third per- 
sonal pronoun or a proper name was sub- 
stituted for the first personal pronoun 
in each item. Sample items of the two 
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forms show their similarities and differ- 
ences. Form A: 4. If I were in charge 
....9. When I was a child... . 16. If 
my father would only.... Form B: 4. 
If Bob were in charge. ... 9. When 
John was a child. ... 16. If his father 
would only.... 


The SCT was administered to 100 
subjects who were patients of Veterans 
Administration New York Regional Of- 
fice Mental Hygiene Clinic. Ninety-six 
of the subjects were males and four 
were females. They ranged in age from 
19 to 51 years with a median age of 27.5 
years. They included 59 psychoneu- 
rotics, 24 psychotics. 13 character dis- 
orders, and four patients with organic 
and narcoleptic disorders. 


The subjects were numbered con- 
secutively in the order in which the test 
was administered to them. Odd-number- 
ed subjects took Form A first, followed 
by Form B. Even-numbered subjects 
took Form B first, followed by Form A. 


The subject’s responses were typed on 
a Rating Sheet according to categories. 
Three psychologists independently rat- 
ed the subject’s degree of disturbance 
in each category on the basis of his four 
responses in that category. The two 
forms of the test were rated independ- 
ently. 

Ratings of the subject’s degree of dis- 
turbance in each category were also ob- 
tained from the psychiatrist by whom 
he was being treated. These ratings 
were based on the psychiatrist’s clinical 
impressions. 

Those ratings on which two of the 
three psychologists (judges) agreed 
were compared with the corresponding 
psychiatrists’ (criterion) ratings. Chi- 

*The following three point scale was used: 
2— Severely disturbed. Appears to require 
therapeutic aid in handling emotional conflicts 
in this area. 1—Mildly disturbed. Has emo- 
tional conflicts in this area but appears able 


to handle them without therapeutic aid. 0— 
No significant disturbance noted in this area. 


squares were obtained and corrected 
coefficients of contingency were calcu- 
lated for the total test, for each area, 
and for each category on both forms of 
the test. In addition, the percentages of 
complete agreements, partial agree- 
ments, partial disagreements, and com- 
plete disagreements between judges’ and 
criterion ratings were computed as a 
basis for comparing Form A with Form 
B. 

A sample of 49 subjects were request- 
ed to compare their responses on Form 
A and on Form B, item by item, and to 
indicate which responses expressed their 
real feelings better. The means of these 
choices were compared. 

The seven psychologists who partici- 
pated most extensively in the experi- 
ment were asked to record their prefer- 
ence for one form of the test and to 
state their reasons for choosing it. 

For a sample of 50 subjects, psychol- 
ogists wrote interpretative summaries 
of the four responses in each category. 
The two forms were interpretated inde- 
pendently by two different psychogists. 
These interpretations were submitted to 
the psychiatrists who were treating the 
subjects with a request to rate the con- 
tent of the statements in terms of their 
agreement with clinical findings. The 
two forms of the tests were compared 
with respect to the proportions of state- 
ments having various degrees of agree- 
ment with clinical findings. 

For a sample of 50 subjects, two psy- 
chologists independently rated each re- 
sponse in terms of positive or negative 
feelings. The two forms of the test were 
compared with respect to the numbers 
of responses which, by agreement of the 
two psychologists, showed each of these 
types of feelings. 

The number of agreements by two of 
the three psychologists making ratings 
of degree of disturbance was compared 
with the number of agreements expected 
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by chance. The same procedure was fol- 
lowed for the number of unanimous 
agreements by the psychologists. 


RESULTS 


The results which were obtained from 
a comparison of the distribution of rat- 
ings by psychologists based on the sub- 
ject’s responses to the SCT and bv psy- 
chiatrists based on their clinical impres- 
sions of the subject are summarized in 
Table I. 


TABLE I 


DISTRIBUTIONS OF RATINGS BY PSYCHIATRISTS 
AND PSYCHOLOGISTS 


Chi- 








Square P C SE 

Form A (N=100) ...... 113.80 .000 .38 .03 

Form B (N=100) ...... 57.04 .000 .27 .04 
Form A Taken First 

CP CRIID “ieisscicistiesnonigin 96.83 .000 .48 .04 
Form B Taken First 

IN csssssssonscenecinatitn 31.19 .000 .27 .05 
Form A Taken After 

Form B (N=50).... 29.66 .000 .27 .05 
Form B Taken After 


Form A (N=50).... 34.3 





The judges (psychologists’) ratings 











tended to agree more closely with the 
criterion (psychiatrists’) ratings on 
Form A for 100 subjects. This trend 
was even more marked on Form A for 
the 50 subjects who took Form A first. 

A comparison of the two forms of the 
test in terms of the percentage of agree- 
ment between ratings by psychiatrists 
and psychologists shows the extent to 
which they agreed or disagreed, on each 
form. Ratings were considered in com- 
plete agreement when both the psychi- 
atrist and the psychologists rated the 
subject severely disturbed, mildly dis- 
turbed, or not showing significant dis- 
turbance. Complete disagreements were 
those in which the psychiatrists or the 
psychologist rated the subject severe- 
ly disturbed, and the other judge rated 
him as not showing significant disturb- 
ance. These results are presented in 
Table II. 

As Table II shows, there were signi- 
ficant differences in favor of Form A 
taken first with respect to the percent- 
ages of complete agreements and com- 
plete disagreements between judges’ and 
criterion ratings. However, there were 
no significant differences between the 











TABLE II 
COMPARISON OF AGREEMENT BETWEEN RATINGS BY PSYCHIATRISTS AND PSYCHOLOGISTS 
i - Form A Form B ‘Diff. — §D 7's t . as 
% % % Diff. 
Complete Agreements 
Both Forms, All Subjects .................... 47.2 43.8 3.4 2.05 1.65 10 
Form A Taken First and Form B 
I I gh cneeacictnnleritnsahereninecs ‘a 51.6 42.3 9.3 2.90 3.21 .00 
Form A Taken Second and Form B 
ED CINE Fb cccdcroasctihdiidiemauncom 42.8 45.4 2.6 2.90 89 .26 
Complete Disagreements 
Both Forms, All Subjects .................... 15.0 17.3 2.3 1.52 1.52 12 
Form A Taken First and Form B 
I Se eee ee 12.2 16.2 40 2.03 1.97 .05 
Form A Taken Second and Form B 
iii el ne AI A 17.8 18.5 0.7 2.25 .29 38 
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two forms of the test for all subjects, 
and for those subjects who took each 
form second. In Form A taken first 
there was a clearly closer relationship 
between ratings than in Form A taken 
after Form B, but there were no signifi- 
cant differences between Form B taken 
first and Form B taken after Form A. 

In Form A, the distribution of the 
judges’ and criterion ratings were found 
to differ significantly from chance in 
eight of the fifteen categories: attitudes 
toward mother, father, family unit, 
heterosexual relationships, superiors at 
work or school, colleagues at work or 
school, attitudes toward future, and 
goals. In Form B, the distributions devi- 
ated significantly from chance in only 
three categories: attitudes toward 
father, heterosexual relationships, and 
superiors at work or school. 

Cases with eight or more complete 
agreements had 13.5 mean hours of 
treatment (SD 8.6) while cases with 
three complete agreements or less had 
6.4 mean treatment hours (SD 3.7). The 
difference between these figures would 
occur by chance less than one time in a 
thousand. There was a tendency for a 
larger number of indeterminate ratings 
and of no-responses to occur among the 
cases with low agreement. 

None of the factors which differenti- 
ated the high-agreement and low-agree- 
ment groups were found to be signifi- 
cantly different when the subjects who 
took Form A first were compared with 
those who took Form B first. Their 
mean treatment hours, for example, 
were respectively 10.1 (SD 7.4) and 8.1 
(SD 5.4). This difference is not signifi- 
cant at the five percent level of confi- 
dence. 

Under a combination of the most 
favorable conditions found in this ex- 
periment, i.e. Form A taken first, nine 
or more treatment hours, considering 
only the eight categories showing signi- 


ficant relationships, 21 subjects were 
found. The ratings of the psychologists 
on these cases corresponded with those 
of the psychiatrists to a degree which 
compares favorably with results ob- 
tained from other projective studies (4, 
5]. The coefficient of contingency was 
57 (SE .08), and 76 percent of the 
ratings were in close agreement or 
partial agreement with the criterion. 

Of the 49 subjects who were asked to 
review their responses item by item, and 
to indicate whether the responses to 
Form A or B represented their feelings 
better, 67 percent chose more responses 
to Form A than to Form B, two percent 
(one subject) chose more responses to 
Form B than to Form A, and 31 percent 
indicated that in the largest number of 
items the responses to both forms repre- 
sented their feelings equally well. 

In the opinions of six of the seven psy- 
chologists who participated most ex- 
tensively in rating and interpreting the 
responses, Form A is preferred for 
clinical use over Form B. 

A significantly greater proportion of 
interpretations of the subjects attitudes 
based on Form A (49.1 per cent) was 
in close agreement with clinical findings 
than that of interpretations based on 
Form B (39.4 per cent). This difference 
is significant at the one per cent level. 
Form A had a smaller number of com- 
plete disagreements (14.7 percent) 
than Form B. (18.6 per cent), the dif- 
ference approaching the five percent 
level of confidence. 

On the whole, the two forms did not 
differ significantly in eliciting responses 
expressing positive feelings, negative 
feelings, indeterminate feelings, am- 
biguous feelings leading to conflicting 
ratings, and failures to respond. In the 
individual categories, a_ significantly 
larger number of negative responses 
was expressed in Form B with regard to 
attitudes toward father and superiors. 
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The extent to which the psychologists 
agreed in their ratings is indicated by 
their deviation from chance expectancy, 
less than one in a thousand for the 
numerical ratings. The results were 
similar for both forms in which two out 
of three psychologists agreed on 92 per 
cent of all ratings, and three psychol- 
ogists agreed on 40 to 45 per cent of all 
ratings. 


DISCUSSION 


The principal finding of this study is 
that significant differences occurred be- 
tween responses to one form of a Sen- 
tence Completion test worded in the 
first person (Form A) and to another 
form consisting of the same items word- 
ed in the third person (Form B). The 
evidence for these differences is as fol- 
lows: 

a. There was a larger percentage of 
complete agreements and a smaller per- 
centage of complete disagreements be- 
tween judges’ and criterion ratings of 
degree of disturbance in favor of Form 
A taken first over Form B taken first. 

b. Significant relationships between 
judges’ and criterion ratings were found 
in eight categories on Form A but in 
only three categories on Form B. 

ec. There was a larger proportion of 
close agreements between content inter- 
pretations and clinical findings in favor 
of Form A. 

d. There were larger proportions of 
responses expressing negative feelings 
in Form B in attitudes toward father 
and superiors. 

e. A larger number of responses to 
Form A as more truly expressing their 
feelings was chosen by 67 per cent of 49 
subjects who were asked to indicate 
their preferences, item by item, while 
only two per cent chose more responses 
to Form B. 

f. A preference for Form A as an 
instrument for clinical use was given by 


six of the seven psychologists who par- 
ticipated most extensively in rating and 
interpreting the SCT responses. 

Thus, while comparison of ratings of 
the total number of subjects on Forms A 
and B showed no significant differences 
between the forms, these figures in- 
cluded subjects who took Form A after 
Form B as well as those who took Form 
A first. This creates an artificial situ- 
ation with regard to comparing the 
forms since if either test were given 
alone there would be no question of it 
being first or second in order. 

It must be noted that these differences 
were found in subjects who are neuro- 
psychiatric patients. Therefore, they can 
be applied to the general population on- 
ly with reservations. 

The differences in favor of Form A 
taken first are consistent with the re- 
sults of Ellis who found significant dif- 
ferences between the average scores of 
problem and nonproblem children only 
on the direct form of a personality in- 
ventory. The direct form also contained 
more items discriminating between the 
two groups than did the indirect forms 
of the questionnaire. 

The larger proportion of responses 
expressing negative feelings in Form B 
is in accord with the findings of Combs 
[12] in comparing autobiographies with 
TAT records. That these differences ap- 
peared in the SCT only with respect to 
attitudes toward father and superiors 
suggests that these two are the most 
important areas of hostility among the 
categories studied. 

The validity figures obtained in this 
study under optimal conditions for 
Form A are in accord with those of Rot- 
ter and Willerman who found a triserial 
coefficient of .61 between ratings on 
their version of the test and the criteri- 
on. Our results are also consistent with 
those of Harrison [5] who obtained 75 
per cent agreement between inferences 
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made from TAT protocols and clinical 
records. On the other hand, we do not 
agree with Lorge and Thorndike who 
concluded that “verbal replies in associ- 
ation and completion tests are largely 
unrelated to the real behavior of a per- 
son,” [6, p. 99] since we include in 
“real behavior” attitudes expressed in a 
clinical treatment situation. 


CONCLUSIONS 


1. The results of this study tend to 
support the hypothesis stated in the in- 
troduction of the problem, that the pro- 
jective responses of individuals to stim- 
uli referring to other people will be sig- 
nificantly different from their responses 
to stimuli referring to themselves, in 
terms of the amount of disturbance re- 
vealed in the areas of personality 
studied, and in the content of attitudes 
indicated. 

2. Five of the six significant differ- 
ences which were found between the two 
forms of a projective sentence com- 
pletion test were in favor of the first- 
person form. 

3. The first-person form of a sen- 
tence completion test (SCT) has been 


demonstrated to be an effective, though 


not exact, method of determining the 
degree of the subject’s disturbance in 
several categories, namely: attitudes 
toward mother, father, family unit, 
heterosexual relationships, superiors, 
colleagues, future, and goals. Agree- 
ments among judges, and between judg- 
es and criterion raters were beyond 
chance expectancy to the extent of less 
than one in a thousand. Under the opti- 
mal conditions found in the experiment, 
76 per cent of judges’ ratings based on 
SCT responses of subjects were in com- 
plete or partial agreement with criteri- 
on ratings based on clinical findings. 
Such results are comparable with valid- 
ity data found in studies of other pro- 
jective techniques. 


4. The first-person form of tne SCT 
was also found to be an effective tech- 
nique for determining the content of a 
subject’s attitude in the categories and 
areas studied. Seventy-seven per cent of 
the interpretations of the attitudes of 
50 subjects were in close or partial 
agreement with clinical findings. 

5. Further investigation is needed 
to demonstrate conclusively that the dif- 
ferences which were found between the 
two forms of the SCT were not due to 
extraneous factors. Suggestions for a 
more rigorous control of such factors 
include: 

(1) Use of an impersonal form of the 
SCT in which only third person pro- 
nouns are used, since names tended to 
arouse associations with specific people. 
(2) A minimum standard of ten treat- 
ment hours of subjects by the psychia- 
trists making criterion ratings 3) 
Periodic reviews of ratings by judges 
and criterion raters to encourage a com- 
mon frame of reference. (4) Correlation 
of SCT findings on both forms with find- 
ings from other projective techniques. 
(5) Determination of optimum intel- 
lectual level for obtaining valid SCT 
responses. (6) Item analyses to deter- 
mine specific stimuli and responses, or 
groups of them, which may be associ- 
ated with high and low agreement in 
ratings, diagnostic classifications, and 
dynamisms of adjustment. 
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EXCEPTIONS TO CERTAIN RORSCHACH CRITERIA 
OF PATHOLOGY 


By J. R. WITTENBORN anp SEYMOUR B. SARASON 


YALE UNIVERSITY 


HERE is a variety of Rorschach 
3 3 responses or characteristics of re- 
sponses which are ordinarily considered 
to be indicative of mental pathology. 
Some of the responses or response char- 
acteristics which have a pathological 
significance are included in the follow- 
ing list: 


1. Poor form level. 
2. Uncontrolled use of color. 
3. Confusion or confabulation of 


concepts. 

4. Symbolic responses. 

5. Content which is a manifestation 
or a projection of anxiety, marked emo- 
tional disturbance, excessive bodily con- 
cern or preoccupation, or marked ag- 
gression towards self or external ob- 
jects. 


Various authorities employ a rather 
arbitrary language when they ascribe a 
morbid significance to such responses as 
the above. Qualifying statements about 
the probability with which the responses 
may be regarded as valid indicators are 
likely to be vague or absent, and, in 
general, statements offered in describ- 
ing the contexts in which the above re- 
sponses are relevant or irrelevant to 
pathology are not explicit or complete. 

The writers have commonly en- 
countered individuals who are manifest- 
ly mentally ill, ie. psychotic, but whose 
Rorschach protocols are free from the 
above described evidence of pathology. 
Such “exceptional” patients are really 
not particularly uncommon and their 
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prevalence suggests an important limit- 
ation in the degree to which the 
Rorschach signs may be relied upon to 
detect mental pathology. It is for the 
possible interest of the newer entrants 
into the field that this present discus- 
sion of exceptions has been prepared. 
Cases not validly appraised by the 
Rorschach have not received recognition 
and professional scrutiny with a fre- 
quency commensurate with their ap- 
pearance. 


The specific responses commonly 
emphasized in the published Rorschach 
literature as evidence of a pathological 
adjustment are not present in the pa- 
tient to be described below to a degree 
comparable with the severity of his 
pathology. Serious pathology does not 
often occur in the total absence of ob- 
servable evidence for unusual, unhealthy 
or perhaps pathological adjustment, and 
it must be noted that the present discus- 
sion does not claim that no examiner 
could predict the state of these patients. 
It is intended, on the contrary, to 
emphasize that valid predictions con- 
cerning these patients could not be made 
on the basis of those Rorschach features 
which are considered to be valid prima- 
rily for such predictions. Obviously no 
test or evaluation procedure can have a 
perfect validity, but a useful statement 
of validity must comprise two parts: one 
which indicates the nature of the valid- 
ity; another which indicates its limit- 
ations. It is natural in employing a new 
technique to explore its possibilities be- 
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fore establishing its limitations. The 
history of intelligence testing is a case 
in point. 

One of the factors which appears to 
discourage the development of helpful 
limiting or qualifying statements con- 
cerning the validity of the Rorschach is 
the practice of ex post facto deduction 
whereby some clinical psychologists, 
when told about some clinically im- 
portant features of a patient, say, “Ah, 
yes. We see indications of it here, and 
here, and here’. Another practice which 
discourages a realistic approach to the 
limitations of the Rorschach is the use 
of ambiguous phrases or esoteric 
Rorschach cliches which can be given al- 
most any specific interpretation which 
subsequent developments may require. 
A less artful, but nevertheless effective 
practice, involves including in the inter- 
pretations widely separated statements 
which can have an almost contradictory 
implication; one or the other of these 
statements may be employed according 
to the requirements of the circum- 
stances. Such resourcefulness on the 
part of the examiner is often ascribed 
to the test itself. 

The following protocol is a good ex- 
ample of the kind of record which 
the writers have encountered from time 
to time among undeniably psychotic pa- 
tients. 


Case A. This patient is a young student vet- 
eran who had been hospitalized for several 
months with a Schizophrenic Psychosis. He 
was tested during a lucid period in which he 
was sociable, hospitable, and composed. Much 
of the time prior and subsequent to testing his 
condition had been grossly psychotic and char- 
acterized by wild catatonic excitements. It 
should be noted that this record does not reveal 
the nature or severity of the disturbance suf- 
fered by the patient shortly before and after 
the lucid period. 


if 1. Pilot in a plane firing a machine 
gun—the man’s in a position to fire 
the gun; you can see him through the 


plexiglass. (Center detail). 

Two Turkeys talking over time of 
day—red heads, feathers. (Whole re- 
sponse). 


Il. 2. 


III. 8. A couple in middle of floor, dancing. 

(Cut-off whole). 

A dog that’s been skinned and 

stretched out. (Whole response). 

All of these remind me of skins of 

animals—rabbit in this case. (Whole 

response). 

V1. (Delay, shifts cards. This is holding 
you up — this is rough — maybe I 
should explain, I’ve been pretty sick 

like equal 

if you guess one half you get 
the other he'f — but you wa 


mite 


— looks design, two 


halves, 
nt a def- 
answer —). 
6. A 30 caliber 
tail). 
Vin, TW Ee 


machine gun. (Side de- 
» old maids at a 
siping. 


4 dog jumping over a 


tea party—gos- 
(Whole response). 


a 
—< 
— 
— 
x 


stump in the 
middle of the woods in the Winter — 
no—in the Summer, because you can 
see his reflection in a stream. (Whole 
response). 

Atom bomb going off — picture of 
sikini Atoll experiment. (Whole re- 

sponse). 
10. Some 


shell 


know 


that’s 
how 


sort of sea 
cracked open, 
colored they are — maybe a horse- 
shoe crab. (Whole response). 

: # (Humorously). You got mad at the 
end of this (referring to blotchy qual- 
ity of card), and threw everything at 
the paper. I’m going to stick by the 
sea. 

11. It’s the color one finds at the sea 
shore about 10:00 A.M., when the sun 
is brilliant — all sorts of animal life 
on the shore — sea weed. (Whole re- 


been 


you vari- 


ponse). 


The fact that the above protocol was 
obtained from a psychotic patient may 
be regarded as sufficient reason for 
scrutinizing the conditions under which 
features of a Rorschach protocol may be 
depended upon as valid aids in apprais- 
ing behavioral pathology. Findings of a 
different sort may add to the interest of 
the present question of validity. One of 
the writers possesses Rorschach proto- 
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cols for a number of distinguished, high- 
ly effective individuals. The protocols of 
some of these persons are of consider- 
able interest because they show a con- 
spicuous use of some of the types of 
Rorschach responses which are com- 
monly taken as almost pathognomonic 
of serious mental pathology. For obvious 
reasons the individuals who have con- 
tributed the Rorschach protocols cannot 
be identified. They are all men of high 
professional standing; their lives are 
characterized by extraordinary and un- 
mistakable achievements. They are men 
who have worked with people and in 
problems involving people; and they are 
men who have worked with principles 
and in problems involving the develop- 
ment of principles. Some of them are in- 
ternationally known. There can be no 
doubt as to the extraordinary quality and 
degree of their achievements. No claims 
are made concerning the social or emo- 
tional adjustment of these distinguished 
people. Their adjustments, whatever 
they may be in truth, have not prevent- 
ed achievements of a high value and a 
history of remarkable intellectual and 
social! efficiency. 


Two records from this group are of- 
fered as examples: 


Case B 


I. Russian double eagle, hobgoblins. 
(Whole response). 

II. Teddy bears, or some animals in the zoo 
at Berne. (Whole response). 

III. I’m hard put to it — seems like an ar- 
gument over food in a world where 
there’s blood and thunder. (Whole re- 
sponse). 

IV. That’s the army with its boots (large 
side detail). By this time, my dear, I 
think the whole thing is silly, I hope 
you don’t mind my saying so. 


V. Butterflies — and Nature. (Whole re- 
sponse). 

VI. Hunting — skin of an animal. (Whole 
response). 


VII. Easter rabbits, or, always see two sides 


to a question. (Upper half of card). 


VIII. (Pause). I don’t get much from that— 

the animals are there and something of 

color — pulling away at the skeleton. 

(Whole response). 

IX. The law of gravitation—heaviest things 
at the bottom. (Whole response). 

X. The whole field of modern chemistry. 
(Whole response). Seems much the same 
—raising the test-tube to the top, or if 
you turn it upside-down, (so doing), the 
test tube is at the bottom. 


Case C 


a Kind of a flying beetle—it has the cen- 
ter line for that hard black surface a 
beetle has — the kind of thing it crawls 
out every year and it hardens and then 
at the bottom it’s almost translucent 
which again is that nearly translucent 
part of the insect. (Whole response). 

II. This is pink optimism on both sides of 
pessimism — you start at the bottom 
with an optimistic idea, then it looks 
black at both sides, but as time pro- 
gresses it turns pink and there’s two 
rosy alternatives turning up, ending in 


optimism. (Whole response). 
Or you could call it pink clouds in a 
sunset — or dawn. (Whole response). 


Ill. A cat’s face—Cheshire grin—those sen- 
sitive black spots on their noses and the 
mouth and whiskers. (Cut-off whole re- 
sponse, exclude color details). 

A hexagon-shaped atoll—with small is- 
lands off each side—the color, to me, in 


this picture, doesn’t contribute any- 
thing. (Cut-off whole response). 
IV. A fox terrier—mutton chops, dropping 


ears, tongue out, with dark places for 
the eyes. (Whole response). 

A muskrat skin drying on a wall — any 
kind of small dark animal — muskrat 
or opposum. (Whole response). 

V. A butterfly—has the antennae and tail 
sections and wings. (Whole response). 
Or you could look at it this way — pro- 
gressing slowly from the bottom, you 
start with two ideas or points of law 
that blend into something — everything 
beyond the middle is ex post facto — it 
narrows as you move forward in time, 
gradually narrows and comes to a con- 
clusion. (Whole response). 

VI. Two distinct issues that come in con- 
flict with each other and then in point 
of time, they go back and back to a point 
even before the issues came up, and then 
as time passes, it narrows down into one 
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Vil. 


VIII. 


IX. 
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more slight issue and narrows back 
again, finally into one solution that real- 
ly goes off into two alternatives. (Whole 
response). 

A Navaho rug design in use of tone and 
gradation of color, abrupt or otherwise. 
(Whole response). 

An animal skin stretched flat to dry. 
(Whole response). 

A population density map of a city. 
(Whole response). 

Less severe than the others—more nebu- 
lous, more fanciful, dreamy, mild, soft, 
harmless that is, the shade and tone of 
the colors. Shapes don’t mean much. 
The human face almost Cro-Magnon 
face profile — with a bushy scalp-lock 
coming from the nape of the head — 
rather Pan-like. (Upper detail). 
Lower center, three-quarter profile of a 
clown-like physiognomy in an apparent 
stupor, with a unicorn forelock. (Cen- 
tral part of side detail). 


The veins or arteries of some animal, 
the capillary and arterial system — the 
red arterial and the blue veins with 
capillaries in various shades between the 
two colors as the oxygen is taken from 
the red in terms of the blue. The rest 
of the alimentary and respiratory sys- 
tem is suggested, too. The lungs, kid- 
neys, two hearts pumping. Somehow the 
grey top part suggests that’s the front 
end of the animal. (Whole response). 
The figures on the extreme right sug- 
gest rodents with sloth-like tails. (Lat- 
eral detail). 

The center part suggests the skeleton— 
vertebrae-like formation. (Upper part 
of center). 


An iris, an orchid or gladiola in leaf 
formation and symmetry in color. The 
use of shades of color gives perspective 
delicateness, and sensitiveness and al- 
most fragrance. (Whole response). 
The center column suggests the filament 
of an electric bulb, or the stamen of a 
flower. (Central light detail). 

The two blue profiles suggest a grim, 
serious, yet humorous person looking 
down toward each corner of the card, 
with a button-like nose, but a scowl on 
his brow and a boyish cowlick of hair. 
(Lateral detail). 

The orange blends in and is joined to the 
blue by a fading diffusion, but the blue 
joins the purple in a distinct series of 


joining arteries which don’t specifically 
blend, it’s a forced adhesion. (Whole 
detail). 

X. The top — suggests the Eiffel Tower — 
wide black base and central sphere — 
the curves of both sides being convex. 
(Upper central detail). 

The blue suggests crustacean forms like 
a crab with a big pincer. (Large side 
detail). 

The two bases of the tower suggest two 
pollywogs looking at each other, angrily, 
with tulips for hair on their heads. 
(Part of upper central detail). 

At the bottom center is the head of a 
grasshopper with antennae and regal 
vestment coming down from each eye on 
the side. 

As a whole, this is the most complex in- 
asmuch as there are four distinct colors, 
each in varying degrees of intensity. 

A purple shoreline dominates through 
the intensity of contrast. (Central red 
detail). 

Starting from bottom to top in point of 
time you again get three or four little 
points of law which eventually narrow 
down to what looks like a conclusion and 
then the yellow shows faint doubt or 
suspicion indicating a need for further 
investigation. (Whole response). 


From an examination of these two 
sets of protocols, it is amply apparent 
that certain evidences of mental pathol- 
ogy which are given high status in the 
Rorschach literature are not dependably 
characteristic of people suffering from 
mental pathology. On the contrary some 
of them may be found among the 
Rorschach productions of individuals of 
extraordinary achievement and mental 
power. Since the Rorschach is used al- 
most exclusively in the appraisal of the 
individual and since little caution has 
been impressed upon the users of the 
Rorschach method, these findings should 
give pause for reflection and emphasize 
the need for a cautious, circumspect em- 
ployment of the Rorschach test in the 
evaluation of an individual in whose ad- 
justment pathology is suspected. 

The capacity to give responses which 
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are plausible and appropriately corre- 
lated with discernable formal aspects of 
the ink blots is taken as evidence for 
good mental ability. Responses which 
make original, uniquely clever, or re- 
sourcefully integrated use of the blots 
are considered as evidence for ex- 
ceptional mental ability. Responses 
which involve impossible or implausible 
concepts, which are vague, or which 
flagrantly disregard the shape of the 
portion of the blot employed or the 
shape of the object perceived are taken 
as evidence for poor mental ability. The 
poor ability itself may result from a 
variety of conditions including the de- 
teriorating effect of disease and emo- 
tional disturbance. 

In the second set of protocols, pro- 
duced by men of extraordinary achieve- 
ment, the general form level of the re- 
sponses was not conspicuously high, un- 
usually good responses were not charac- 
teristically prevalent, and vague, ques- 
tionable form levels were commonly pro- 
duced. In order to demonstrate further 
the limitations with which form level 
may be used as evidence for mental 
ability and in order to emphasize the 
need for careful statements qualifying 
and specifying their relevance, the pro- 
ductions for a number of patently 
feebleminded people are here presented. 

The responses in Table I were obtain- 
ed from institutionalized defective in- 
dividuals of varying levels. In all but a 
few instances the individual traced the 
response before any inquiry was at- 
tempted. The tracings made the evalu- 
ation of form level free from the sub- 
jectivity involved where only the verbal- 
izations of the subject are available. 

A study of these responses reveals 
that feebleminded individuals can give 
responses which are clearly of good 
form in the sense that the area of the 
card used corresponds to the content of 
the response. These responses are not 


TABLE I 


SOME RORSCHACH RESPONSES OF FEEBLE- 
MINDED SUBJECTS 








Case 1—M. A. 5-2, C. A. 24, I. Q. 36 


CardII —(Two men (4 — whole card. He 
points out the parts of the usual 
men: nose, mouth, neck, feet and 
knees. The elongated part of the 
top red is a hat. This boy has a 
speech defect and when he was 
asked “why two men”?, he spontane- 
ously got up from his chair and 
demonstrated the “patty-cake” 
movement. 





Case 2—M. A. 5-7 C. A. 24-1, I. Q. 37 


CardII —A pig (< — the usual black area). 
Points out the usual ears, nose, eye 
and feet. (Traced). 


Case 3—M. A. 5-9, C. A. 27-6, I. Q. 38 


Card X —A stove (A — the entire gray por- 
tion at top). Points out the chim- 
ney, and the bottom side projection 
are nicely fashioned into the legs of 
the stove. (Traced). 








Case 4—M. A. 6-8, C. A. 17-8, I. Q. 44 


Card II —A chicken (V — combining the bot- 
tom two projections in an unusual 
way). Points out neck, nose, eye, 
and the comb region. (Traced). 


Card III —A clown (A — the head, neck, and 
upper part of body the usual 
men). The shaded area at the top 
of the head is made into the clown’s 
hat, and the light portion in the 
check region is “cheap paper” on 
his face “to make it look like the 
head is dressed up”. (Traced). 

Card V —A lady with eye glasses (jA—the left 
half of the top usual small detail 
immediately below the “horns’’). 
Points out the nose, mouth and “just 
one eyeglass” which is tiny shad- 
ed circle right above the nose. 
(Traced). 





Case 5—M. A. 5-10, C. A. 11-8, I. Q. 50 

Card1IX—(A — usual top orange area). 
Points out the eye, nose, hat and 
makes an orange projection into a 
broomstick (“she flies up in the air 
with the broomstick”). (Traced). 
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TABLE I (continued) 








Case 6—M. A. 7-10, C. A. 28-4, I. Q. 52 

Card X —A jack rabbit (< — the side gray 
without the area protruding into the 
yellow). The top projection are the 
ears, and the bottom projection are 
fashioned into legs and tail. The 
head of the rabbit is seen as if in 
profile. (Traced). 

Card X —A reindeer (A — the side gray to- 
gether with yellow). What were the 
ears of the ears of the rabbit be- 
comes the front feet of the rein- 
deer. What was the body of the rab- 
bit is fashioned into the reindeer’s 
“horns and a long neck”. The yel- 
low is the body and tail. (Traced. 
Because the gray and yellow both 
are considered “figure”, the white 
surrounding being the “ground”, the 
tracing made it considerably easier 
for the examiner to evaluate the re- 








sponse). 
Case 7—M. A. 7-0, C. A. 13-2, I. Q. 54 
CardI —Mittens (A — top small detail). 


Points out they are snow mittens 
because of the thumbs. This re- 
sponse is then organized with the 
next response in the adjacent small 
detail, two heads; “the people are 
wearing those mittens”. (Traced). 

Card III —Giraffe (A — the usual side detail). 
Points out the long feet, long neck, 
ete. (Traced). 

Card IV —A giant (A — whole card). Points 
out the face, ears, and big feet. 
“He’s big and husky”. (Traced). 


Case 8&—M. A. 6-6, C. A. 11-9, I. Q. 55 


Card 1V —A ghost (A — the whole card ex- 
cept for middle bottom projection). 
Demonstrates the bent position of 
the arms. “He has black things all 
over him and black shoes on his feet. 
He’s scaring somebody”. 

Card VII—Rabbits (A — upper side two- 
thirds). Points out the face, ear, 
tail, eye, body, but “there are no 
legs. They are both talking togeth- 
er’. (Traced). 

Card IX —Reindeer (A — the top orange). 
Points out the eye and horns. 
“This (outer edge) is the front of 
him. He’s laying down like”. 
(Traced). 
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TABLE I (continued) 





Case 9—M. A. 11-6, C. A. 16-2, I. Q. 77 

Card IX —A man playing some kind of instru- 
ment. (A — the head of the usual 
witches and the adjacent orange). 
Points out the usual facial features. 
The orange projection is the instru- 
ment and he is playing it “Because 
it is in his mouth”. (Traced). 








vague or undifferentiated; on the con- 
trary, the way in which the blot area is 
delineated to fit a particular class of ob- 
jects indicates a conceptual activity. In 
fact, were certain of these responses to 
be given by clinically average or above- 
average people one would very likely say 
that they were indicative of “original” 
thinking or good intellectual potentiali- 
ty or both. In other words, if a “bright” 
person gave some of these responses one 
would not be surprised ; when it is given 
by an institutionalized, defective person 
a ready explanation is not at hand. It 
should be noted, of course, that these de- 
fective subjects also gave “poor” re- 
sponses. The examples in Table I are the 
exception rather than the rule. However, 
the clinician is still faced with the 
question of the interpretive or behavior- 
al significance, of a “good” — even an 
original — response or responses in a 
record otherwise characterized by a 
combination of vague, popular, and ir- 
rational forms. In the case of subjects 
1, 2, and 3, what is the significance of 
their responses in light of their very low 
mental levels? The response of subject 
3, considered an original response by the 
writers, is most unusual for an individu- 
al of that level. The responses of sub- 
jects 1, and 2, although of the more 
usual variety, again are not what one 
expects to obtain from a sample of such 
an intelligence level. 


An explanation employed by some 
clinicians is that since these responses 
are infrequently found among defectives 
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and are more frequently found among 
those of average or above-average intel- 
ligence, that therefore, the capacity of 
these individuals is higher than intelli- 
gence test results indicate and for one 
reason or another this capacity is not 
being utilized. Such an explanation does 
not readily explain two observations: 
first, practically none of the subjects 
listed in Table I has ever demonstrated 
in the course of his life a learning or 
adaptive capacity noticeably above that 
indicated by the intelligence quotient; 
second, that each of these subjects can 
be matched with another defective of 
similar mental level, whose Rorschach 
contains no suggestion of higher capac- 
ity, but whose academic learning or 
adaptive capacity is better. In other 
words, there is no behavioral correlate 
to the clinician’s conclusion. To use 
Rorschach responses in the present in- 
stance as criteria for “higher poten- 
tiality” would seem to be unwarranted. 


It might be justifiably maintained 
that the methods of observation, train- 
ing, and therapy employed with defec- 
tives, in addition to the unreliability and 
incompleteness of case history data, pre- 
vent the clinician from evaluating con- 
clusions about the relation between 
functioning and capacity. Such a con- 
tention opens a wide area for research. 
However, until such research is done, 
the validity of conclusions about intel- 
lectual functioning based on Rorschach 
responses must be questioned. 


SUMMARY 


The writers have become increasingly 
aware of the large number of instances 
wherein responses allegedly of patholo- 
gical significance occur in the pro- 
ductions of people whose adjustment is 
not particularly atypical or pathological. 
Similarly, individuals known to suffer 
conspicuously from marked mental 
pathology are not consistently judged to 
be appropriately pathological when any 
particular set of Rorschach responses 
characteristics is employed. Moreover, 
Rorschach evidence for good ability may 
be found among the grossly feeble 
minded and Rorschach evidence for poor 
ability or mental inefficiency may be 
found among the conspicuously effect- 
ive. Since the Rorschach is used in the 
evaluation of the individual, exceptional 
cases are of interest and have the fol- 
lowing implications: 

1. Careful statements qualifying the 
relevance of characteristics of pathology 
must be prepared. Such qualifications 
should be based on controlled studies, 
not on more “expert opinion” or on 
authoritative “common sense’. 

2. Caution should be employed when 
using any particular Rorschach charac- 
teristics as evidence for or against a 
particular pathology. The conditions 
under which they are associated with 
pathology have not been well specified 
and the strength of their relevance is 
undetermined. 


Received September 27, 1948 











THE UTILITY OF WECHSLER’S PATTERNS IN THE 
DIAGNOSIS OF SCHIZOPHRENIA‘ 


By LOUIS S. LEVINE? 


STANFORD UNIVERSITY AND VETERANS ADMINISTRATION HOSPITAL, PALO ALTO 


HE manual for the Wechsler-Belle- 

- vue Intelligence Test stresses the 
potential clinical utility of this instru- 
ment for differentiating between a va- 
riety of psychiatric disorders [10]. This 
differentiation is based, not on the tra- 
ditional intelligence quotient, but rather 
on the individual patterns composed of 
the variation of subtest scores about 
their own mean. 

The present study has been designed 
to test the diagnostic utility of the psy- 
chometric patterns presented by Wechs- 
ler [10] as characteristic of schizo- 
phrenia. Comparisons between official 
hospital diagnoses and diagnoses based 
solely on the W-B psychometric pattern 
provide the basic data for inferences 
concerning the diagnostic utility of the 
pattern. Such data provide information 
as to how often these patterns are cor- 
rect and how often incorrect in the 
diagnoses they imply. 

Previous attempts to evaluate Wechs- 
ler’s patterns have dealt with the com- 
parison of various diagnostic groups on 


1Published with permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who as- 
sumes no responsibility for the opinions ex- 
pressed or the conclusions drawn by this au- 
thor. 

2Based on a thesis submitted to Stanford 
University in partial fulfillment of the re- 
quirements for the degree of Master of Arts. 
The writer gratefully acknowledges his in- 
debtedness of Dr. Howard F. Hunt, Dr. Maud 
Merrill James and Dr. Quinn McNemar of the 
Department of Psychology, Stanford Univer- 
sity, and to Mr. Robert E. Kantor of the Psy- 
chology Staff of the Veterans Administration 
Hospital, Palo Alto, California. 


the basis of their subtest variability 
[1, 3, 4, 5, 7]. This procedure only 
establishes that certain group differ- 
ences in subtest patterns occur. It does 
not, however, determine the accuracy 
with which such patterns may be used 
in the diagnosis of individual cases. The 
present study directly attacks this latter 
problem — accuracy of individual diag- 
nosis from psychometric patterns. 


PROCEDURE 


Of the 294 patients admitted to the 
Veterans Administration Hospital, Palo 
Alto, between January 1, and May l, 
1947, 110 were accessible white males 
from 18 to 40 years of age inclusive. 
These cases constituted the sample for 
the present study. The cases in the 
sample had been diagnosed as follows: 
Schizophrenia (all types) 46; Manic- 
Depressive Psychosis 4; Psychoneurosis 
41; Psychopathic personality 9; Psy- 
chosis with organic involvement 4; Psy- 
chosis with alcoholism 1; Mental de- 
ficiency 2 and Undiagnosed 3. The mean 
age for the sample was 25.4 with a 
standard deviation of 5.7, while the 
mean IQ was 102.7 with a standard 
deviation of 16.2. The sample cases 
ranged in education from no formal 
schooling through three years of post- 
graduate work, with modal frequencies 
at the educational levels of eighth and 
twelfth grades. 

All cases in the sample took Form I of 
the Wechsler-Bellevue Intelligence Test 
within 3 weeks following admission to 
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the hospital and prior to the initiation 
of therapy. These tests were scored in 
accordance with the standard procedure 
and the deviation symbols indicated. 
Each test record was transcribed to a 
blank form which contained no identify- 
ing information except for a code num- 
ber. 

Five clinical psychologists, utilizing 
only the transcribed records and the test 
manual, individually diagnosed each 
case in the sample in accordance with 
the diagnostic signs and method sug- 
gested by Wechsler. All of these psy- 
chologists had MA degrees and were 
advanced students in clinical psychol- 
ogy.2 Presumably they were as well 
qualified as many of the individuals who 
normally attempt to use these profiles 
diagnostically. 

Each psychologist received the follow- 
ing instructions: 

These tests are to be diagnosed in accordance 
with the information contained in Chapter 11, 
Measurement of Adult Intelligence (3rd Ed.) 
by David Wechsler. 

When decision has been reached as to the 
diagnostic group that the profile most closely 
resembles: 

1. Remove the attached slip from the test 
form. 
2. Write diagnosis on it. 

Tests will fall into each of the categories of- 
fered by Wechsler, but not necessarily in equal 
numbers. 

Do not mark test forms or keep a record of 
the diagnoses made. 

In addition to the diagnostic profiles offered 
by Wechsler, you may use the category “Un- 
classified” to describe the test profiles which 
do not approximate any of Wechsler’s profiles 
sufficiently to warrant a diagnostic impression. 


The diagnoses from the test records 
fell into all the categories discussed by 
Wechsler — Schizophrenic, Mental De- 
fective, Psychopathic, Organic, and 
Neurotic. 


®The clinical psychologists who participated 
in the study were: William A. Cass, Jr., Abra- 
ham Carp, Charles W. Erikson, James Doug- 
las Grant, and Clarence L. Winder. 


Official final hospital diagnoses served 
as the criterion with which the diag- 
noses from W-B performance were com- 
pared. All diagnoses were made in ac- 
cordance with standard psychiatric 
practice by a diagnostic staff which 
varied from patient to patient. This 
procedure probably increased the vari- 
ability in the diagnostic standards em- 
ployed, but it also probably decreased 
the liklihood of systematic error or dis- 
tortion in diagnosis. 

In the present study both criterion 
and W-B diagnoses were divided into 
two categories: schizophrenia and non- 
schizophrenia. Statistical treatment was 
based on this dichotomy to provide in- 
formation as to the diagnostic adequacy 
of the schizophrenic pattern. Cases cal- 
led “Unclassified” by any individual 
psychologist were excluded from the 
statistical comparisons between his W-B 
diagnoses and the criterion. All data on 
agreement between hospital and test 
diagnoses thus refer only to those cases 
in which the test results seemed suf- 
ficiently unambiguous to justify diag- 
nosis. This experimental procedure du- 
plicates, within reasonable limits, the 
clinical situation in which the clinician 
may withhold diagnosis if the data are 
ambiguous. 


RESULTS 


Table I compares the official hospital 
diagnoses with diagnoses made by psy- 
chologists on the basis of Wechsler’s 
system. The chi-squares indicate that 
the agreement between W-B and hos- 
pital diagnoses is of borderline statisti- 
cal significance. The percentage of 
agreement ranges from 59.7 to 67.2 for 
the cases classified. The frequency of 
“Unclassified” cases varies from 11.3 
through 36.6 per cent of the sample for 
the different psychologists; the median 
being 32.8 per cent. This high incidence 
of unclassified cases must be taken into 
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TABLE I 
AGREEMENT BETWEEN W-B AND HOSPITAL DIAGNOSES* 
cit soa es Psychologists " % 
“a coupe “co “7” coun? 
Number of cases diagnosed from W-B........ 72 74 72 95 68 
Per cent of observed agreement....................... 67.2 60.8 59.7 62.1 66.1 
Per cent of agreement expected by chance... 56.7 49.9 50 45 54.4 
x? (W-B vs Hospital Diagnoses) ..................... 5.47** 3.99 3.03** 4.95** 8.97 
Level of x? significance (1 d.f.) -...................... <.02 <.05 >.05 <.05 <.05 

















*The three cases designated as ‘“‘Undiagnosed” by the hospital staff do not appear in this table because their 
criterion diagnosis was undetermined. 
**Yates correction for discontinuity was applied to all contigency tables in which the expected frequency in any 





particular cell was less than 10. 


account when the general diagnostic 
utility of the method is considered. 

Comparisons between each psychol- 
ogist and each of the others with re- 
spect to their diagnoses of individual 
cases indicate the consistency of the W-B 
diagnostic procedure. Again data were 
treated statistically on the basis of a 
schizophrenic-nonschizophrenic dicho- 
tomy. Agreement as to W-B diagnoses 
occurred in from 68 through 83 per cent 
of the cases diagnosed by both members 
of each pair. The N for these compari- 
sons varied from 52 through 70. The 
agreement for 9 of the 10 pairs was 
statistically significant (P < .01), while 
the agreement for one pair only ap- 
proached borderline significance (7? = 
3.01, P > .05). 

These data indicate that the raters 
were fairly consistent in their perform- 
ance with regard to the diagnoses as- 
signed. Although the agreement between 
paired psychologists was statistically sig- 
nificant, disagreement occurred in from 
17 through 32 per cent of the cases diag- 
nosed. Though this unreliability doubt- 
less provides a source of disagreement 
between the W-B and criterion diag- 
noses, other factors such as the possible 
invalidity of the W-B patterns might al- 
so contribute. The relative importance 
of these different sources cannot be 
evaluated from the data of this study. 


The difference in accuracy between most 
and least “accurate” psychologists was 
not statistically significant, however 
(77 = .09, P > .05). It seems, therefore, 
that the experimental method employed 
was sufficiently consistent to justify its 
use in the present study. 


CONCLUSIONS 


The results of this study do not neces- 
sarily indicate that these W-B diag- 
nostic patterns are invalid. Rather, they 
suggest that the patterns have definite 
limitations as practical, clinical diag- 
nostic devices. Though the agreement 
between the psychologists as to test di- 
agnoses was statistically significant for 
nine of the ten pairs, the disagreement 
between them ranged from 17 through 
32 per cent of the cases diagnosed. This 
disagreement suggests that the profiles 
overlap sufficiently to make discrimi- 
nations between them both difficult and 
unreliable for some cases. For this, and 
probably other unspecifiable reasons, 
from 11.3 through 36.6 per cent of the 
cases could not be diagnosed. Further- 
more, though the agreement between 
test and criterion hospital diagnoses 
was of borderline statistical signifi- 
cance, the error ranged from 33 through 
40 per cent of the cases diagnosed. 


Received August 2, 1948. 
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WECHSLER-BELLEVUE PATTERN ANALYSIS 
IN SCHIZOPHRENIA 


By LENNART C. JOHNSON 


CHICAGO STATE HOSPITAL, CHICAGO, ILLINOIS 


HE intention of this study was to 

compare the test scores of clinical- 
ly diagnosed schizophrenic patients at 
the Chicago State Hospital with Wechs- 
ler’s [2] Schizophrenia Pattern Analy- 
sis, using the Wechsler-Bellevue Adult 
Intelligence Scale. No attempt was made 
to segregate our sample group of schizo- 
phrenic patients into subtypes since 
Wechsler’s pattern is based on a blanket 
schizophrenic category. 


SUBJECTS 


Sixty-nine white subjects were used, 
36 females and 33 males, ranging in age 
from 15 to 59 years, with a mean age of 
35 years. Educational backgrounds 
ranged from 4 years to 15 years of school 
training, with a mean education of 10 
years. To eliminate subjects who might 
present a pseudo-picture of normality 
due to the limited variability of scores 
which might result from intellectual de- 
ficiency, only subjects with IQ’s over 80 
were included in the study. No evidence 
was available to show that test scatter 
would increase in subjects with IQ’s 
above 110. 


PROCEDURE 


Test score patterns were computed by 
averaging each individual’s subtest devi- 
ation from his total weighted score 
mean, excluding Vocabulary. In an ef- 
fort to discover the relationship between 
ability and variability in subjects with 
1Q’s over 110, we divided our population 
into two groups, those with IQ’s over 


110, and those with IQ’s under 110. The 
subtest means and SD’s were then com- 
puted for the two groups and a Coeffi- 
cient of Variation obtained for each sub- 
test so that the percentage of variability 
could be expressed. 


RESULTS 


After dividing our population into 
two groups, those with IQ’s under 110, 
and those with IQ’s over 110, we found 
59 cases in the former group and only 
10 cases in the latter. Thus while the 
size of our sample would not permit a 
generalized statement regarding ability 
and variability for the subjects with 
IQ’s over 110, we felt that results would 
at least express the relationship occur- 
ring within our study. The mean vari- 


TABLE I 
PERCENTAGE OF SUBTEST DEVIATION AGREE- 
MENTS WITH WECHSLER’S PATTERN ON THE 
WECHSLER-BELLEVUE SCALE FOR 69 
SCHIZOPHRENIC PATIENTS 











Per cent Percent Percent 
of of of 

Subtests Total Male Female 

Group Group Group 
ea .59 By AT 
SE 75 .78 -72 
II ledsneedicnceecls 49 50 AT 
eet 49 .50 AT 
SIS: <cntaccaniuus 87 .93 80 
FOOGM i...2. 21 18 .25 
a .66 54 17 
SS .63 .66 61 
o>) .08 .09 .08 
_ See .63 .66 .61 
D. S .20 24 16 
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TABLE II 
COMPARISON OF PERCENTAGES OF SUBTEST DEVIATIONS ON THE WECHSLER BELLEVUE 
SCALE FOR SCHIZOPHRENIC PATIENTS AT CHICAGO STATE HOSPITAL 
AND A VETERANS ADMINISTRATION HOSPITAL* 











Deviations 
—2.50 and —1.50 to —1.49 to +1.50 to +2.50 and 
over —2.49 +1.49 +2.49 over 

CSH VA CSH VA CSH VA CSH VA CSH VA 
ee Se 01 04 .07 .00 ol 49 .26 .28 33 19 
OO 01 10 .05 10 52 39 17 13 .23 27 
SRE .20 30 .20 15 37 43 Al 07 10 04 
Be eivhiinnpakedcesaad .23 .22 07 10 42 34 13 13 .08 19 
ee 17 10 14 10 34 51 .20 15 13 13 
WR ccenisincedoves 02 .04 05 .04 .50 .66 18 16 21 09 
SS See .23 .28 .23 15 42 39 04 Al 07 O7 
ST ee 13 .06 oan .06 42 56 .20 | 21 15 
ee ae .08 .09 17 .08 .55 44 08 .28 10 10 
Se Soe - oo .09 .08 .06 33 35 17 16 31 34 
RE See 24 32 .20 18 OT AT 14 .00 .02 03 





*Figures for the Veterans Administration Hospital are derived from Garfield [1]. 


ability obtained for the under 110 group 
was 36.24 per cent. The mean vari- 
ability obtained for the over 110 group 
was 30.7 per cent. The results of our 
scatter analysis are presented in Table 
I. Table II presents a comparison of per- 
centage deviations between Garfield’s 
[1] schizophrenic group and ours. 


SUMMARY AND CONCLUSIONS 


Schizophrenic patients do not present 
a consistent symptomatology on the 
Wechsler-Bellevue Intelligence Test. Ob- 
tained test scatter exceeds the vari- 
ability limits established by Wechsler. 
The Information, Picture Arrangement, 
and Block Design subtests are the most 
confirmatory of Wechsler’s limits, yet 
are verified by less than two-thirds of 
the population. 

Sex differences are not sq apparent 
and would militate against a sex basis 
for interpreting test patterns. A notable 
male superiority is discernible on the 


Information and Picture Completion 
subtests, probably a product of their 
more extensive environmental contacts 
and pressures. 

There is a close correspondence be- 
tween the achievements of the two 
schizophrenic populations. The test be- 
havior of both groups extends the vari- 
ability limits throughout the entire con- 
tinuum of possible test scores. 

Incidental to the study is the tentative 
finding that test variability does not in- 
crease with IQ’s above 110. The size of 
our sample, however, necessitates fur- 
ther investigation of this problem. 


Received August 14, 1948. 
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CLINICAL INTUITION AND TEST SCORES AS A 
BASIS FOR DIAGNOSIS’ 


By HAROLD KLEHR 


NORTHWESTERN UNIVERSITY 


HILE clinical psychologists in 
their testing activities largely 
are concerned with diagnostic inter- 
pretation based upon objective test 
scores, it is generally accepted that they 
also make use of the raw data furnished 
by the subject’s behavior in the testing 
situation in arriving at interpretive, 
subjective judgments. This is in addi- 
tion to the kind of clinical judgment in 
which the psychologist integrates the 
test results with the case history, medical 
reports, and other information [2]. 
Any test situation offers a sample of 
human behavior. The clinician has 
available two general methods with 
which to evaluate the behavior sample: 
(1) he can use an objective scoring 
technique, and (2) he can make a sub- 
jective interpretation based on his clini- 
cal experience. The latter type of inter- 
pretive judgment is sometimes referred 
to as “clinical intuition; more correct- 
ly, though, it is termed “clinical judg- 
ment.” Actually, this judgment is not 
intuitive in the classical sense, but is 
based upon objective data derived from 
the subject’s behavior, even though the 
‘This study is part of a larger project being 
conducted at Northwestern University under 
the direction of Professor William A. Hunt, 
and subsidized by the Office of Naval Research 
under its policy of encouraging basic research. 
The opinions expressed, however, are those of 
the author and do not represent the opinions 
or policy of the naval service. For their co- 
operation on various aspects of the study, 
thanks are due to the staff of the Great Lakes 
Naval Training Station, to Dr. Phyllis Witt- 
man and the staff of the Elgin State Hospital, 


and to Mr. William Sloan and staff of the Lin- 
coln State School and Colony. 


cues upon which the interpretations are 
based may be neither verbalized nor 
conscious. Both Hunt [3] and Cofer [1] 
have recently stressed the importance of 
such subjective judgments in the clini- 
cal situation. 

Clinicians, however, often have been 
embarrassed about using subjective pro- 
cedures. This stems partly from scien- 
tific bias against “nonstandardized” or 
“nonobjective’” methods, and partly 
from the fact that while subjective 
judgment is used commonly in inter- 
preting test behavior, little work has 
been done under controlled experimental 
conditions to validate clinical judgment 
as a procedure. It is such validation that 
this paper presents. A situation is creat- 
ed in which the diagnostic judgment of 
the psychologist, arrived at by a purely 
qualitative interpretation of test re- 
sponses, is compared with the diagnostic 
results of applying an objective scoring 
system to the same test behavior. 

For our purposes, the CVS abbrevi- 
ated individual intelligence scale was 
used [4]. CVS consists of the Compre- 
hension and Similarities subtests from 
the Wechsler-Bellevue scale [8] and a 
fifteen-item Thorndike revision of the 
Stanford vocabulary scale [7]. CVS is 
not only a test of intelligence, but it also 
has possibilities as a clinical diagnostic 
instrument. Its clinical potentialities 
have been borne out in studies in which 
the differences between an individual’s 
vocabulary performance and his reason- 
ing ability have been shown to have di- 
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agnostic significance. This is particular- 
ly true of schizophrenia. The “scatter” 
measure utilized with CVS has been the 
presence of both Comprehension and 
Similarities scores that are below that 
for Vocabulary. This criterion success- 
fully identified 62 per cent of a group of 
schizophrenic cases while falsely identi- 
fying only 19 per cent of a normal con- 
trol group [5], which compares favor- 
ably with other tests used for diagnostic 
purposes. CVS also offers an absolute 
score that is useful in identifying mental 
defectives. If we set as a cutting point 
a total score which is two standard devi- 
ations below the mean for the group of 
normals on whom the test was standard- 
ized, we have a criterion which identi- 
fied 77 per cent of a group of mental de- 
fectives while falsely identifying only 2 
per cent of a group of normal individu- 
als [5]. Since this performance com- 
pares favorably with other tests used 
for the purpose of screening mental de- 
fectives, CVS thus offers objective diag- 
nostic criteria against whose perform- 
ance we can compare the subjective di- 
agnostic judgments of clinical psychol- 
ogists using clinical “intuition” based 
upon a qualitative evaluation of test re- 
sponses without application of objective 
scoring techniques. 

There is a further important aspect of 
our study. It proposes to use an abbrevi- 
ated individual intelligence scale rather 
than one of the longer ones such as the 
complete Wechsler-Bellevue. One criti- 
cism that has been raised against ab- 
breviated tests is the claim that they do 
not offer sufficient material for valid 
clinical interpretation. Should it prove 
possible for clinicians to make valid 
clinical judgments using the test re- 
sponses furnished by an abbreviated 
scale, we would have further argument 
for the use of such abbreviated tests 
when time is at a premium. 


PROCEDURE 

The material to be evaluated consist- 
ed of the CVS test responses of 36 sub- 
jects: 12 schizophrenics, 12 mental de- 
fectives, and 12 normals. To assure 
their “normality,” the normal subjects 
were taken from a group of naval re- 
cruits who had passed a naval psychi- 
atric screening examination. The mental 
defectives and schizophrenics were in- 
stitutionalized persons upon whose diag- 
noses the hospital staff was in unani- 
mous agreement. The age range of all 
subjects was from 17 to 28, and the 
school grade completed ranged from 7 
to 134% with the exception of the mental 
defectives, few of whom had received 
formal education and none of whom had 
gone beyond the 8th grade. The normals 
and schizophrenics were individually 
matched for age and education. 

All subjects were given the CVS scale 
in an individual testing situation and 
their responses were taken down verba- 
tim by the examiner. Testing was done 
by trained examiners with extensive 
clinical experience. The data were sub- 
jected to objective scoring by the stand- 
ard scoring techniques for the CVS bat- 
tery [4,6]. A “test diagnosis” of schizo- 
phrenia was made on the basis of the 
measure mentioned above (C and § 
scores less than V). The previously es- 
tablished criterion for mental deficiency 
(a score of 2 standard deviations below 
the mean) was used for the “test diag- 
nosis” of mental deficiency. These ob- 
jective measures have been shown ex- 
perimentally to be of value. 

As representative clinicians, 15 clini- 
cal psychologists were selected who were 
considered to be at an advanced level 
and who had had long experience in in- 
dividual testing. Ten of the clinicians 
were diplomates in clinical psychology 
of the American Board of Examiners 
in Professional Psychology. While the 
remaining clinicians were not diplo- 
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mates at the time, they were adjudged 
by a committee of two advisors to be 
eligible for such certification. They all 
represent a high level, older group of 
clinicians which should be typical of the 
best in present day clinical psychology. 

The verbatim test responses of each 
subject were mimeographed on separate 
sheets, and all 36 sheets were then pre- 
sented to each clinician, with the in- 
structions that he read the test re- 
sponses and make a purely qualitative 
judgment (without any assistance from 
objective scores) based upon his inter- 
pretation of the raw test responses. The 
clinicians were told that the group con- 
tained schizophrenics, mental defectives, 
and normals but were not told how 
many subjects of each type were includ- 
ed. The specific instructions were as fol- 
lows: 


The enclosed test records contain responses 
from subjects tested at the Great Lakes Naval 
Training Station and at the Illinois State Hos- 
pitals. The records contain test results from 
three groups: the normal, the mental defec- 
tive, and the schizophrenic. Tests used were 
the Wechsler-Bellevue Comprehension and Sim- 
ilarities and the Thorndike revision of the 
Stanford Vocabulary scale. 

Please evaluate qualitatively the test results 
for each case and check the group in which you 
think it belongs (normal, mental defective, or 
schizophrenic). Base your decision on the 
qualitative aspects of the responses, exclusive 
of any objective scoring. For your convenience, 
a master sheet with the test questions is in- 
cluded. 


There is a data sheet for each subject. After 


checking the category in which you feel the 
subject should be placed, please write the quali- 
tative cues (which you are able to verbalize) 
that determined your judgment. 

Your judgments will be kept anonymous. 


As a final control, to assure that the 
clinicians’ judgments were a function 
of their clinical training and experience, 
a group of 15 relatively inexperienced 
graduate students were also asked to 
evaluate the protocols qualitatively 
under the same instructions. These 15 
graduate students had had one year of 
graduate work which included class in- 
struction in testing as well as actual ad- 
ministration of the Wechsler-Bellevue 
scale. 


RESULTS 


The results in terms of the number of 
cases correctly diagnosed in each cate- 
gory is given in Table I, which shows 
the number of cases identified by the ob- 
jective scoring in comparison with the 
average performance of clinicians and 
graduate students. 

Since there are three categories with 
12 cases in each, the chance expectancy 
for correct identifications would be four 
out of each group of 12 cases. Inspection 
shows that both the quantitative scoring 
technique and the qualitative judgments 
of the clinicians operate above chance, 
while the graduate students do not. 
Since inspection shows that the devi- 
ation from chance is in the direction of 
correct identifications, the chi-square 


TABLE I 
MEAN NUMBER OF CASES DIAGNOSED IN EACH CATEGORY (SCHIZOPHRENIA, MENTAL 
DEFICIENCY, NORMAL) BY CLINICIANS, GRADUATE STUDENTS, 
AND OBJECTIVE TEST SCORES 














Schiz. Defect. Normal 
Clin. Stud. Test Clin. Stud. Test Clin. Stud. Test 
Schiz. called................ 6.6 $.1 6.0 P| a 1.0 4.7 7.2 5.0 
SS see ee 2.6 2.7 2.0 8.8 1.7 10.0 6 7.6 0.0 
ng lt 2.7 5 4.0 5 6 1.0 8.8 10.9 7.0 
|| 7.3 12.0 10.0 3.0 12.0 14,1 25.7 12.0 
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technique was applied to evaluate the 
statistical significance of the deviations. 
For the objective scoring criterion and 
for the clinicians’ judgments, the P 
values of the obtained chi-squares were 
less than .01. The students did not per- 
form above chance expectation. The P 
value for the chi-square of their dis- 
tribution was greater than .50. We 
therefore conclude that the diagnostic 
ability of both clinicians and test is 
based upon a performance which is sig- 
nificantly greater than chance expec- 
tation. 

The use of the average score conceals 
whatever individual differences in clini- 
cal ability may exist among the 15 
clinicians. It must be remembered that 
the test and scoring criteria are uniform 
instruments which operate with the 
same validity in any situation. Clinical 
ability varies from clinician to clinician. 
In terms of the ability to interpret 
qualitatively a subject’s performance 
from CVS, our clinicians showed a wide 
range of variability. 

The further question arises of the 
representativeness of our normal and 
clinical groups within the narrow age 
range used. In a sampling as small as 
this one (12 cases in each category), 
such a question is important and the 
care with which the subjects were se- 
lected is still no guarantee that they are 
representative. By comparing the per- 
formance of the CVS battery on our 
small groups to that previously reported 
for larger groups [5], we find that the 
test performed comparably in both situ- 
ations. In the previous study [5], our 
scatter criterion identified 62 per cent 
of the schizophrenics while falsely iden- 
tifying only 19 per cent of the normals 
and 19 per cent of the mental defectives. 
This compares with percentages of 50, 
33, and 16 per cent, respectively, iden- 
tified in our study. In the previous 
study, 2 per cent of the normals were 


falsely identified as mental defectives 
while 77 per cent of mental defectives 
were correctly identified. This compares 
with 8 per cent and 84 per cent in the 
present study. These results would sug- 
gest that our small samplings are com- 
parable to the larger ones used in the 
previous study. 

In considering the demonstrated abil- 
ity of the clinician to make valid diag- 
noses based on the qualitative interpre- 
tation of test responses, we must call 
attention to the artificiality of our sit- 
uation, remembering that in the actual 
clinical situation he has not only the 
test responses but also the whole wealth 
of observable behavior which the sub- 
ject demonstrates simultaneously in the 
test situation. We can rightfully feel 
that clinical judgment in an actual sit- 
uation would be even more effective. 

In conclusion, it should be pointed out 
that our approach has possibilities for 
the development of objective methods of 
testing individual clinical ability. Such 
material expanded and standardized on 
a large number of clinical subjects 
might give us norms against which to 
evaluate students in training as well as 
established clinicians applying for li- 
censing and certification. The develop- 
ment of such measures, however, would 
demand further validation and a thor- 
ough standardization. 


SUM MARY 


The present study has compared the 
ability of a group of 15 experienced 
clinicians to diagnose mental defectives 
and schizophrenics on the basis of pure- 
ly qualitative interpretation of test re- 
sponses, with the diagnostic results of 
applying an objective scoring technique 
to the same material. The results indi- 
cate that the performance of the clini- 
cians under these circumstances is com- 
parable to the use of an objective scor- 
ring technique, both performances be- 
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ing significantly better than chance. It 
should be noted that the use of an ab- 
breviated test in this study demonstrates 
that despite their shorter form, these 
tests still offer sufficient material for 
the exercise of valid clinical judgment. 
A control group of graduate students 
did not differ significantly from chance, 
indicating that the clinical judgment ex- 
hibited by the clinicians is a function 
of training and experience. It is sug- 
gested that the experimental method 
employed in this study might be ex- 
panded to provide objective measures 
of clinical ability. 


Received August 20, 1948. 
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THE TEST-RETEST RELIABILITY OF THE WECHSLER- 
BELLEVUE INTELLIGENCE TEST (FORM I) FOR 
A NEUROPSYCHIATRIC POPULATION” 


By RICHARD C. HAMISTER 


STANFORD UNIVERSITY AND VETERANS ADMINISTRATION HOSPITAL, PALO ALTO 


HE Wechsler-Bellevue Intelligence 
g Scale (W-B) currently serves in 
many clinical situations not only as a 
measure of intelligence but also as an 
aid in differential diagnosis. According 
to instructions given in the manual, pa- 
tients may be assigned to different diag- 
nostic categories on the basis of subtest 
variability; subtest variability can simi- 
larly contribute a measure of deteriora- 
tion. These applications assume that 
various intellectual functions are differ- 
entially affected by different kinds of 
mental illness so that characteristic pat- 
terns of intratest variation emerge on 
testing. The use of patterns in differ- 
ential diagnosis necessarily implies the 
assumption of a reasonably valid and 
reliable measuring instrument. 


The present study is designed to yield 
information concerning the consistency 
with which the subtests of the W-B 
measure whatever they purport to meas- 
ure. There are at present no published 
figures on this point. Wechsler quotes 
reliability figures for the Full Seale, but 
not for the separate subtests or for the 


1Published with permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who as- 
sumes no responsibility for the opinions ex- 
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Performance and Verbal Scales. Such 
subtest reliability information is impor- 
tant since it determines, in part, the 
confidence which may be attached to 
statements about patterns of subtest 
variation. 

All patients entering a Veterans Ad- 
ministration neuropsychiatric hospital 
over a two-month period were can- 
vassed for inclusion in this experiment. 
To be included in the sample a patient 
had to be: (1) native born, (2) non- 
Negro, (3) aged 18 through 40, (4) 
without previous experience with the 
W-B, and (5) accessible and free from 
influence of drugs for both the first 
and second tests. Fifty-three patients 
fulfilled these specifications. The first 
test was administered from three to six 
days after the day of admission. 

The official hospital diagnoses of the 
patients in the sample are as follows: 
Schizophrenia (all types), 34; Manic- 
Depressive, 2; Traumatic Psychosis, 1; 
Psychosis (unclassified), 1; Psychoneu- 
rosis (all types), 9; Psychopathic Per- 
sonality, 3; Epilepsy, 1; Chorea, 1; and 
Mental Defective, 1. The total group had 
a mean age of 29.26 with an SD of 6.37 
years ; the mean of the schizophrenic pa- 
tients was 29.12 with an SD of 5.9. 

Only patients producing test-retest 
results on at least eight of the subtests 
were included in this sample. Others 
were excluded because of insufficient co- 
operation. For disturbed patients the 
decision as to the desirability of at- 
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tempting testing was left entirely to the 
subjective judgment of the tester and 
the attending physician. With one ex- 
ception attributable to the tester’s 
oversight, all patients actually tested 
completed all eleven subtests. The pa- 
tients excluded from the sample on the 
grounds of probable non-cooperation 
were in most cases so out of contact or 
so disturbed as to require continuous 
tubs. Some of the patients in the sam- 
ple, however, were actively hallucinated 
or deluded, or both. Though some of 
these were tested only a short time after 
having left the tubs, the testers found 
them fully cooperative. Testing condi- 
tions were generally described as good. 
The results obtained strengthen the im- 
pression given by the testers’ state- 
ments. The means and SD’s for most 
of the subtests are close to those found 
for Wechsler’s standardization group 
[1]. The mean IQ of the total group 
computed from the first test was 102.70 
with an SD of 16.81. These figures 
compare favorably with those quoted 
by Wechsler for this general age 
range. For his standardization group, 
the mean varied from 99.57 to 100.89; 
the SD from 13.70 to 15.50. It seems 
probable, then, that the patients form- 
ing the experimental sample were in 
such condition that testing was feasible. 
Although the criteria for selection could 
have distorted the representativeness of 
the sample, the group seemed to the test- 
ers to be fairly representative of the pa- 
tient population routinely referred for 
testing at this hospital. Reliability fig- 
ures based on this sample should be par- 
ticularly relevant. 


PROCEDURE 


On admission to the hospital, each pa- 
tient was assigned two testers, one for 
the first test and one for the retest. No 
tester ever examined a particular pa- 
tient twice. The following system dic- 
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tated assignments. Each tester had a 
number. The numbers ran from l 
through as many more as there were 
testers available. Although seven differ- 
ent testers actually participated, usually 
no more than four were available at a 
time so four numbers were generally ac- 
tive. The patients were scheduled for 
initial tests in order as they entered the 
hospital on the basis of the hospital reg- 
ister numbers assigned consecutively to 
all admissions regardless of previous 
residence in the hospital. Each tester 
preceded and followed every other test- 
er with about the same frequency. This 
effectively precluded any systematic 
bias which might have been introduced 
had the same tester administered both 
tests or had one tester always followed 
another. All seven testers were gradu- 
ate students in psychology and interns 
in the Veterans Administration Psy- 
chological Training Program. All had 
administered a minimum of seventy-five 
W-B tests prior to the beginning of the 
study. 

Some question exists as to the appro- 
priate interval to interpose between 
testing and retesting. A short interval 
is convenient in that many more pa- 
tients are available for retesting at the 
end of a shorter period than at the end 
of a longer period. The shorter interval 
has an additional advantage in that the 
effects of extensive therapeutic pro- 
grams do not have much opportunity to 
cause major changes in the patients. On 
a priori grounds the short interval has 
the disadvantage of maximizing mem- 
ory and learning effects. Since it did 
not appear practical to extend the inter- 
val beyond one month, intervals of a 
week and a month were employed. The 
patients were assigned either of the two 
intervals on the basis of their hospital 
register numbers, the week interval for 
patients with odd numbers, the month 
interval for patients with even numbers. 
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The differences between the means for 
the two interval groups were insignifi- 
cant (¢ test) in the case of each subtest. 
No ¢t value exceeded 1.8 and only 4 ex- 
ceeded unity with 52 degrees of free- 
dom. Also, though there was definite 
evidence of a learning effect from first 
to second test, the magnitude of this ef- 
fect did not appear to be related to the 
length of the interval between tests. Ac- 
cordingly, the week and month interval 
groups were combined for the purpose 
of computing reliability coefficients. The 
final sample included 33 patients who 
had been retested after an interval of a 
week and 20 patients who had been re- 
tested after an interval of a month. The 
mean difference between total scores on 
test and retest for the total group was 
10.75 weighted score points. The SD of 
this distribution of differences was 12.61 
which indicates great variability and 
that losses as well as gains appeared on 
retest. The difference between test and 
retest means was highly significant 
(CR = 6.1). 

The sample includes 34 schizophrenic 
patients. Statistics for this group were 
computed separately because of the par- 
ticular importance of this diagnostic 
group. In order to permit some com- 
parison of both groups with a standardi- 
zation group the means and SD’s for 
Wechsler’s subjects in the age groups 
between 20 and 39 were combined. The 
three groups to be compared, then, are 
quite similar with respect to age. 


RESULTS 


Table I shows the test-retest reliabil- 
ity coefficients together with the test-re- 
test means and SD’s for the total group, 
the schizophrenic group, and Wechsler’s 
norm group. Test-retest results are pre- 
sented for the various scales of the test 
(Verbal, Performance, and Full), for 
the Verbal versus the Performance 
Seales, and for the Deterioration Index. 


The information which Wechsler in- 
cludes in the manual does not permit the 
computation of combined means and 
SD’s for the Verbal and Performance 
Scales or for the Deterioration Index. 
He reports reliability figures only for 
the Full Scale (test-retest Rho = .94, 
N = 20, age group 20-34) and for the 
Verbal versus Performance Scale 
(r = .83, N = 355, age group 20-34). 


TABLE I 
TEST-RETEST RESULTS FOR A NEUROPSYCHIATRIC 
POPULATION 


Mi M: 


Information 





SDi SD; 


ra SEM 


Total Group 
(N = 53) 10.51 
Schiz. Group 
(N = 34) 9.91 19.7 
Norm Group 
(N = 455) 10.0 3.2 
Comprehension 
Total Group 
(N = 63) 
Schiz. Group 
(N = 34) 
Norm Group 
(N = 455) 10.0 
Arithmetic 
Total Group 
(N = 53)........ 9.62 
Schiz. Group 
(N =— $4) 
Norm Group 
(N = 455) 9.5 
Digit Span 
Total Group 
(N = 52) 
Schiz. Group 
(N = 34). 7.71 8.71 3.36 3.82 .63 
Norm Group 
(N = 455) 9.5 


11.09 3.06 2.95 94 ~ 


11.02 


10.32 10.65 3.32 3.10 .78 


——— 
87* 1 


9.24 


Similarities 
Total Group 
(N = 63)... 
Schiz. Group 
(N == 34).... 9.47 
Norm Group 
"(N = 455) 9.8 2.5 
Vocabulary 
Total Group 
(N = 653) 
Schiz. Group 
(N = 34) 
Norm Group 
(N = 455) 
Picture Arrangement 
Total Group 
(N == 63)... 
Schiz. Group 
(N = 34)... 
Norm Group 
(N = 465)...... 9.7 3.3 


3.96 3.52 86 41.4 


10.83 11.26 2.96 2.84 90 9 


10.41 11.00 3.14 3.02 -90 


No information 


3.15 4.18 78 
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TABLE I (continued) 

















M; M: SD: SDs rm: SE 
Object Assembly 
Total Group 
CN == 68)........ 10.86 12.06 3.48 2.92 .66 1.9 
Schiz. Group 
(N == 34)........ 10.12 11.68 38.61 38.07 .62 
Norm Group 
(N = 455)...... 9.7 2.9 
Block Design 
Total Group 
(N = 53)... 9.98 11.22 2.70 3.35 T1 1.6 
Schiz. Group 
(N == 34)........ 9.62 11.15 2.43 3.34 .6T 
Norm Group 
(N = 455)....... 10.0 3.6 
Picture Completion 
Total Group 
(N = 53 10.86 11.30 3.19 3.27 wi iz 
Schiz. Group 
(N = 34)........ 10.08 10.85 3.55 3.57 .68 
Norm Group 
(N = 455)...... 9.7 3.2 
Digit Symbol 
Total Group 
(N = 63)... 8.02 9.58 2.738 2.86 .80 1.2 
Schiz. Group 
(N = 384)... 7.68 9.47 2.99 38.10 .79 
Norm Group 
(N = 455) . 9.9 3.6 
Deterioration Index 
Total Group 
(N = 52)....... 18 13 19 .20 -76 -l 
Schiz. Group 
(N == 34) 18 ll -22 28 76 
Verbai Scale 
Total Group 
(N = 62) 48.73 62.73 14.72 15.01 91 4.6 
Schiz. Group 
(N = 34) 47.03 61.38 15.97 16.27 91 
Performance Scale 
Total Group 
(N == 68)........ 48.34 54.98 10.85 18.44 83 6.1 
Schiz. Group 
(N = 34) 46.50 58.88 11.58 14.76 .80 
Full Scale 
Total Group 
(N = 652)... 96.62 107.46 24.07 26.49 .87 9.1 
Schiz. Group 
(N = 34)........ 92.97 104.26 26.00 28.91 84 
Mp My SDp SDy Tpv 
Verbal vs. Per- 
formance 
(Test 1) 
Total Group 
(N = 53).. 48.34 49.27 10.85 15.10 .80 
Schiz. Group 
(N == 34)... 46.50 47.02 11.58 15.97 .82 
Verbal vs. Per- 
formance 
(Test 2) 
Total Group 
(N = 62)........ 64.65 652.73 13.41 15.01 -79 
Schiz. Group 
(N = 34)....... 53.38 61.38 14.76 16.27 .80 





*The SD of the Arithmetic subtest for this population 


DISCUSSION 


As mentioned in the introduction, 
Wechsler has proposed a scheme for 
utilizing the characteristic patterns of 
subtest variability in differential diag- 
nosis. The symbols “plus” and “minus” 
denote direction of deviation of each 
subtest score from the individual’s mean 
while the number of plus or minus signs 
associated with each subtest indicates 
the magnitude of the particular subtest 
deviation. He proposes the following 
approximate quantitative equivalents 
for the symbols: [1, p. 153] 


a deviation of from 1.5 to 2.5 units above 
the mean subtest score 

| +. q deviation of 3 or more units above the 
mean subtest score 

—a deviation of from 1.5 to 2.5 units be- 

low the mean subtest score 

——a deviation of 3 or more units below the 
mean subtest score 


As the figures in Table I indicate, the 
test-retest reliabilities of the eleven sub- 
tests differ considerably. Two coeffici- 
ents are in the nineties, three in the 
eighties, four in the seventies, and one 
each in the sixties and fifties. When 
standard errors of measurement (SEx)* 
are computed it becomes apparent that 
the range within which true scores can 
be expected to lie is quite large relative 
to the possible total range in score for 


8An estimate of trait variability was ob- 
tained by averaging the test-retest SD’s. 





was very much larger than that of the standardization 
group. It was also large in comparison with the SD’s ob- 
tained for the other subtests within this population. The 
possibility of a sampling error was considered, but when 
the SD for 232 additional first-test Arithmetic scores 
turned out to be 4.15 the likelihood of sampling error 
as an acceptable explanation of the difference became 
small. It may be that the true SD for a hospital popu- 
lation is closer to 4.5 than to 3.0. It may be also, that 
the SD for the standardization group is not typical since 
it was recruited exclusively from the state of New York. 
If the SD obtained in the present study is in error, the 
obtained reliability coefficient of .87 is spuriously high. 
Corrected for dispersion, using an SD of 8.0 rather than 
4.60, r becomes .67 in place of .87. Further investigation 
of the effects of NP disorders on arithmetical reasoning 
will be necessary before the best estimate of the true SD 
for this population can be determined. 
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some subtests. For Information this 
range (plus and minus 2 SE) is 3.2 
weighted score points while for Digit 
Span it is 8.8 weighted score points. For 
seven of the subtests this range is equal 
to or greater than 6 weighted score 
points, one-third or more of the total 
possible variation for any subtest. For 
all except four subtests, then, deviations 
up to and including the standard three 
weighted score points above or below the 
mean weighted score could easily be a 
function of errors of measurement. For 
example, the P value (probability of oc- 
currence by chance) for a deviation of 
1.5 weighted score points can vary from 
.04 in the case of Information to .24 in 
the case of Digit Span. A more precise 
method for determining the significance 
of weighted score deviations is needed; 
the errors of measurement involved in 
the different subtests should be taken 
into account in determining the signifi- 
cance of subtest deviations. 

These comments refer only to the nu- 
merical equivalents quoted above. Wech- 
sler explicitly states that his values are 
approximate and that judgments as to 
the strength of “plus” and “minus” dev- 
iations must in the last analysis be clini- 
cal. The quantitative approximations 


provided by Wechsler are, however, 
quite misleading. 


SUMMARY 


Form I of the Wechsler-Bellevue In- 
telligence Scale was administered twice 
to 53 NP patients. The retest was ad- 
ministered after an interval of one week 
to 33 patients and after one month to 
the other 20. The differences between 
the group which was retested at the end 
of a week and that which was retested 
at the end of a month were not signifi- 
cant. A statistically significant increase 
of 10.75 weighted score points on the 
second test was found when the two 
groups were combined. In addition to 
test-retest reliability coefficients, means, 
SD’s, and SEy’s are reported for the 
subtests and for the various scales. The 
magnitude of possible errors of meas- 
urement for this sample differed mark- 
edly for the different subtests. This 
should be taken into account in further 
studies of subtest patterns. 


Received August 27, 1948. 
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A COMPARISON OF THE REVISED ARTHUR PER- 
FORMANCE TESTS (FORM Il) AND 
THE 1937 BINET 


By MILDRED E. HAMILTON 


CEDAR CREST COLLEGE 


HE most popular performance test 

of general intelligence in use today 
is the Arthur Point Scale of Performance 
Tests (Form 1). Louttit and Browne 
[3] found it being used in 29 out of 43 
clinics responding to their question- 
naire. It achieved a mention rank of 
15.5 (the lowest was 97.5). When the 
frequency of mention was weighted for 
frequency of use, the Arthur achieved 
a rank of 7.5, placing it among the ten 
tests most frequently used. The publi- 
cation in 1947, then, of the Revised Ar- 
thur Scale Form II could be expected to 
be met with a great deal of interest. It 
is possible that there will be a tendency 
to supplant Form I with the Revised 
Form II for several reasons: there are 
fewer tests (five instead of Form I’s 
nine), they are easier to arrange and 
give (fewer form-board pieces to deal 
with), they are very easy to score, and 
the whole test can be given “nonlan- 
guage” with no awkwardness. And of 
course, the materials are vastly inter- 
esting to the subjects taking the test. 
School children, at least, enjoy the Re- 
vised Arthur Form II. 


Arthur herself does not intend that 
Form II shall take the place of Form I, 
but “its primary purpose is to serve as 
an alternate to Form I when a second, 
similar scale is needed for retesting pa- 
tients in psychological clinics.” [2] 

It might also be hoped by some that 
the validity of the new test might be 
somewhat improved over the older one. 
It is a curious fact that, in spite of the 


popularity of the Arthur I, there is very 
little literature on the validity of the 
test. A recent publication by Wallin 
[4] presents some comparisons of the 
Arthur I with both the 1916 and 1937 
Revisions of the Binet. The subjects in 
his study were a dull group with aver- 
age IQs in the 70’s. He reports discrep- 
ancies between the Arthur and the Bi- 
net which are higher than one would 
like. For example, in 43 per cent of the 
cases a difference of more than ten 
points, and in 16 per cent of the cases 
a difference of more than 20 points, was 
found between Arthur I and 1937 Binet 
1Q’s, the direction of the difference be- 
ing sometimes in accordance with ex- 
pectations and sometimes not. There 
was a general tendency for the Arthur 
to give higher IQs than the Binet, e.g., 
36 per cent of the differences of more 
than ten points were in the direction of 
higher Arthur scores. 


It is true that the chief argument for 
the validity of the Arthur Performance 
Tests lies in the ability of the separate 
tests to discriminate between chrono- 
logical age groups, and in the discrimi- 
native capacity of the total point scores. 
These, of course, have been carefully de- 
termined by the author of the tests. 
However, since the final score is in 
terms of IQ, and since IQ has come to 
have meaning mainly in terms of the 
1937 Binet (the Louttit and Browne ar- 
ticle shows the 1937 Revision being giv- 
en in all of the clinics responding, the 
1916 Revision in none) and the Wech- 
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sler-Bellevue, with a general population 
mean IQ of 100 and a standard devia- 
tion of about 15,—an IQ which remains 
relatively constant and which means the 
same thing throughout the age scale — 
it seems entirely fair to ask what rela- 
tion the Arthur Performance IQ bears 
to these others. 

The manual for administering and 
scoring the tests (Form II) reports a 
comparison of Form I and the Revised 
Form II of the Arthur for 94 individ- 
uals. The “median algebraic difference” 
is —5.0, Form II giving a lower average 
1Q, and the “median arithmetic differ- 
ence” is 6.0. A comparison of the Ar- 
thur II with the Binet (the author does 
not indicate which revision was used) 
on these same 94 cases is reported. The 
“median differences” here are: algebra- 
ic, 0.0; arithmetic, 6.0. With no further 
breakdown of the data, it appears that 
the Arthur II agrees with the Binet at 
least as well as, if not better than it does 
with the Arthur I. The time interven- 
ing between tests is not given, buf it is 
stated that Form I always preceded 
Form II, and it is probable that the Bi- 
net followed both Arthurs. 

At first glance, these results may 
seem highly encouraging. But read the 
description of the group [2, p. 22]: 


Among these 94 individuals many types of 
cases frequently seen in psychological clinics 
are represented: organic (brain injury) with 
special difficulty in dealing with spatial rela- 
tions; glandular imbalance ... , severe read- 
ing disabilities . . . , special language abilities 

. » impaired hearing ... , impaired vision 

. . , individuals upset emotionally at the time 
of one test. [italics mine], individuals with 
superior endowment but poor work habits; and 
superior individuals who want help in educa- 
tional or vocational planning. 


It is granted that median differences 
tell, in themselves, extremely little about 
the validity or reliability of a test, but 
a median arithmetic difference of only 
six points between the Arthur II and the 


Binet on such a group seems most curi- 
ous, since it is precisely with such 
groups that differences are supposed to 
show up, if one keeps in mind the raison 
d’etre of performance tests. 

With a view to seeing whether the Re- 
vised Arthur II might suitably supplant 
Form I, the new test was given to nor- 
mal school-children without being pre- 
ceded by Form I, and the 1Q’s compared 
with those obtained on the 1937 Revi- 
sion of the Binet, Form L. We cannot, 
on the basis of these data, question the 
findings of Arthur, but they are present- 
ed for what they are worth. 


THE STUDY 


General Descriptive Data. The group 
of subjects comprised 40 school children 
from two middle class American schools 
in Allentown, Penna.’ They were not 
clinic cases, but were sent to the exam- 
iner by the teachers as “some judged to 
be above average, some about average, 
and some below average” as requested. 
Some of the subjects were tested as 
prospects for classes for gifted children. 
All of the tests were administered by 
the writer under favorable conditions. 
In every case but one the Binet was giv- 
en first, the interval between the two 
tests ranging from one-half day to nine 
months, with 65 per cent of the subjects 
having both tests within a 14 week 
period. 

There were 25 boys and 15 girls rang- 
ing in age from 6-0 to 12-11 years, but 
actually, only one child was above 11-11 
years. Table I summarizes the test data. 
The size and selection of the group 
would not lead one to expect an IQ av- 
erage of 100 on the Binet. The differ- 
ence between the means no doubt re- 
flects, not a tendency of the Binet to 


'The author gratefully acknowledges the co- 
y oag pr se of Mrs. Mabel A. Lilly, principal of 
the Jefferson and Lincoln schools in Allentown, 
Miss H. M. Warfield, school psychologist, and 
the teachers in the two schools. 
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TABLE I 


AVERAGES AND VARIABILITY OF IQ’s ON THE 
1937 BINET AND THE REVISED ARTHUR 











Form II 
ate, Tap ~ BinetIQ Arthur ILIQ 
i csaheniicitin 74-166 72-141 
EE Ee 106.5 100.0 
et RR Bee 108.0 100.0 
~ SRT 20.5 16.6 





give an inflated IQ, but a tendency of 
the Arthur II to give a lower IQ than 
the Binet. 

The correlation between the Arthur 
II and the Binet was .73 with a P.E. of 
.05, showing that the two tests rank in- 
dividuals in a group in relatively close 
positions. The mean difference between 
the two tests without regard to sign was 
12.97 IQ points, while the algebraic 
mean of the differences was —7.47 IQ 
points, the minus sign indicating that 
the Arthur II IQ was generally lower 
than the Binet. 

The distribution of IQ differences is 
shown in Table II. Note that 20 out of 
the 40 cases, or 50 per cent, differed 
from the Binet IQ by more than 10 
points, while 8 out of 40, or 20 per cent, 
differed by more than 20 points. 

Comparison of IQs by IQ Groups. On 


BINET 
1Q 
136-166 


126-135 

L16-125 

106-115 
96-105 
86-95 
74-85 2) 


TABLE II 


DIFFERENCES IN IQ POINTS BETWEEN THE 1937 
BINET AND THE REVISED ARTHUR FORM 
II PERFORMANCE SCALE 





Arthur lower 1Q Arthur higher 


than Binet Points than Binet 
5 1-5 6 
4 6-10 4 
5 11-15 0 
5 16-20 2 
3 21-25 0 
1 26-30 0 
2 91-35 1 
0 36-40 0 
1 41-45 0 
86 ae as” {a 
one case: 
no difference 
Algebraic mean of differences: —7.47 
Arithmetic mean of differences: 12.97 


breaking down the data into age groups, 
and into Binet IQ groups, even in this 
small sample, two systematic “errors” 
appear. These are shown in the accom- 
panying graphs. Figure 1 shows that, 


of the subjects with Binet 1Q’s of 85 or 
less, all of the Arthur ITI IQ’s were high- 
er, none were lower. In the next higher 
group (86 to 95) most of the Arthur II 
1Q’s were higher, only 20 per cent being 





Fig. 1. Percentage of Cases in Each 1937 Binet IQ Group in which the Arthur Form II 


IQ is Lower. 
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| -26.6 | 136 8 over 
| -20.0 | 26135 
| -53 _| 16-125 
| -8.4 | 106-115 
“24 | 96-105 


Fic. 2. Algebraic Average of IQ Differences 


Binet 1Q Groups. 


lower. In general, the Arthur II 1Q’s 
are higher for those with Binet 1Q’s of 
95 or less. When we get to the next two 
IQ groups, we find that the Arthur II 
gives an IQ generally lower than the 
Binet, 77.7 per cent of the differences 
being negative in the 96 to 105 Binet IQ 
group, and 70 per cent being negative 
in the 106 to 115 Binet IQ group. All 
of the subjects with Binet 1Q’s above 
115 earned lower IQ’s on the Arthur II. 
There seems, then, to be an overesti- 
mation on the Arthur II for dull sub- 
jects, (this incidentally, supports Wal- 
lin’s findings on the Arthur I and the 
Binet) and underestimation on the Ar- 
thur II for average and bright subjects. 

Figure 2 tells us something of the 
magnitude of the differences between 
the Arthur II and the 1937 Binet for 
these same classifications. The closest 
agreement between the two tests is 
found in the 86 to 95 IQ group, where 
the Arthur II is higher than the Binet 
by an average of 1.8 IQ points. As we 
move away from this group in either 
direction, the differences between the 
two tests increase, reaching the very 
large figure of 26.6 points by which the 
Arthur is lower than the Binet in the 
136-IQ-and-over group. The reversal in 
the 116-125 group is probably due to 
small N. If it is combined with the 126- 
135 group, the two together give Arthur 





86-95 


74-65 | 





7a 


between Arthur Form II IQ and 1937 Binet by 





II 1Q’s lower than Binet by an average 
of 10.3. 


CA 


tf 
id 


9 


6 4.4 





Fic. 3. (Algebraic) 


Average 
which Arthur Form II IQ is Lower than 1937 
Binet IQ for Several Age Groups. 


Amount by 


Comparison of IQ’s by Chronological 
Age Groups. When the data are broken 
down by age groups, it is found (Fig- 
ure 3) that in the six-year group the 
Arthur IT IQ is lower than the Binet by 
an average (algebraic) of 4.4 points. 
And, as we go up to the higher age 
groups, the magnitude of the underesti- 
mation of Arthur II increases until we 
reach the 1ll-year group. The arithme- 
tic mean differences were also calculat- 
ed but are not shown graphically. These, 
for the six, seven, eight, nine, ten and 
eleven-year groups respectively were 
6.9, 12.0, 10.9, 16.0, 16.0 and 21.3, con- 
firming the general picture of wider dis- 
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22% 





Fig. 4. Percentage in Each Age Group with Arthur Form II 1Q’s Differing Ten Points or 


More from 1937 Binet. 


crepancies between Binet and Arthur 
II IQ’s with increase in age. Figure 4 
also confirms this by showing that as 
we go to higher age groups, a larger and 
larger percentage of the subjects show 
a divergence of 10 or more IQ points 
from the Binet. 


POSSIBLE EXPLANATIONS OF LACK 
OF AGREEMENT 


Some of this tendency of the Arthur 
II to rate average and bright subjects 
lower than the Binet does could possibly 
be explained on the basis of practice ef- 
fects. Form II was standardized on sub- 
jects who had already taken Form I. 
Our subjects, lacking this practice, make 
lower scores, hence lower IQ’s. It might 
be ventured that the brighter children 
would have had the most benefit from 
practice, hence, when practice is lack- 
ing, they are the more heavily penalized. 
Also, older children might be the ones 
who would benefit most from practice 
(would they?), and thus are the ones 
in whom the lack shows most clearly. 
Invoking a “practice effect” explanation 
does not make interpretation of the Ar- 
thur II IQ any easier, for practice is a 
variable with varying influence at dif- 
ferent ages and at different levels of in- 


telligence, and is related to length of 
time intervals between Form I (prac- 
tice) and Form II (retest). It does not 
seem wise to have such a variable, 
whose influence is unknown and im- 
measurable, “sealed into” the test as it 
is. 


A second suggestion is that the stand- 
ardization group did not adequately 
sample the population, and that it was 
weighted on the brighter side. The 
group of more than 900 subjects who 
were the standardization population are 
described as coming from the same 
“middle class American district” as was 
used in standardizing Form I. There is 
some evidence in Arthur’s description 
of this group [1] that children of par- 
ents in the lower occupational categor- 
ies were inadequately sampled. Using 
the Goodenough classification, about 30 
per cent of the population of the U.S. 
(1930 census) fell in the two lowest 
groups. In Minneapolis 27 per cent of 
the population was included in these 
groups, but in the standardization sam- 
ple only 13 per cent of the children had 
parents in these classifications. Also, in 
the manual for the Revised Form II the 
author states, “Through some accident 
of selection the 10.5- and 11.5- year 
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groups were exceptionally bright. .” and 
“The 14.5- year group was regarded in 
the school as being brighter than the 
15.5- year group.” The author did try 
to make allowance for these unusually 
bright groups by smoothing median 
scores to fit the curve, but one wonders 
whether the group as a whole was not 
too much on the bright side. 

A third hypothesis to account for the 
1Q differences is suggested by the data 
which show greater discrepancies as one 
goes up the C.A. scale. Since average 
point scores were determined for each 
year level, intermediate scores being in- 
terpolated, and since nothing was done 
to control IQ variability at the different 
age levels, it might be that the standard 
deviation of the IQ is similar to the Bi- 
net at about the six-year level, but di- 
minishes regularly at higher age levels. 
No data are given by Arthur as yet on 
this point, and it would indeed be con- 
trary to expectation. Data on the Ar- 
thur I show a variable SD of IQ’s, but 
they do not vary systematically. The 
range of SD’s for boys and girls aged 
five to fifteen years was from 10 to 21. 
If such variation in SD does show up 
on the new Arthur, its value as a diag- 
nostic instrument will be considerably 
depreciated. 

On the other hand, if the SD’s of Ar- 
thur II IQs were relatively constant, 
then the trend we speak of might arise 
through increase in the spread of Binet 
1Q’s. Standardization data on the 1937 
Binet Form L gave an SD of IQ at age 
six of 12.5. For the next four years it 
was constant at 16, and for year 11 it 
was 18. Comparison of these SD’s with 
Figure 3 show that they do not ade- 
quately explain the trend. 

It is this author’s contention that in 
view of the apparent need for a good 
performance test of general intelligence, 
and the discriminative capacity of the 
Arthur subtests, the attractiveness of 


the materials, ease of giving and scor- 
ing, and the great amount of work that 
has already been done on it, that the 
test is worth further work toward mak- 
ing it a more perfect measuring instru- 
ment. Would it not be worthwhile to 
take the point scale one step further, and 
do as Wechsler did with his test? Vide- 
licet, give the test in its present form to 
an unquestionably adequate sampling of 
children. Determine the mean and the 
variability of total point scores, and ar- 
bitrarily assign a specific 1Q to a cer- 
tain degree of variability. This might 
be done for four-month intervals from 
age 5 to 10, for yearly intervals from 11 
to 14, and in addition there could be 
younger adult and older adult groups. 
This would necessitate about 2400 sub- 
jects. Perhaps it would not be too diffi- 
cult with cooperation among school sys- 
tems and clinics. 

It seems also that it might be not only 
worthwhile, but necessary, even if the 
foregoing is not possible, to establish 
norms for the new Form II for subjects 
who have not had Form I. That should 
be a fairly simple matter if enough per- 
sons are interested, and it would surely 
make the test more useful. 


Received August 30, 1948. 
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OPINIONS CONCERNING INCIDENCE AND DIS- 
CHARGE RATES FOR MENTAL ILLNESS 


By GLENN V. RAMSEY 


UNIVERSITY OF TEXAS 


HIS paper reports the results ob- 

tained from a public opinion sur- 
vey which procured estimated figures 
for the incidence and discharge rates for 
mental illness. The respondents were 
asked to estimate the hospital admission 
rate for mental illness, its incidence 
among men and women, and the insti- 
tutional discharge rate for mental cases. 
The responses to each of these questions 
were then analyzed according to the 
background variables of age, sex, race, 
religious affiliation, educational level, 
and occupational class. The purpose of 
this survey was first to determine in 
general the public’s conception of the 
magnitude of the problem of mental ill- 
ness and the attitude toward its amen- 
ability to treatment, and, in the second 
place, to discover any possible relation- 
ships between the responses and the six 
background factors. 

The questionnaire was individually 
administered to 241 persons in Trenton, 
New Jersey, who were selected on the 
basis of a quota-controlled sample for 
the total population. The variables of 
sex and race in the group studied did 
not exceed by more than 2.5 per cent 
their presence in the total population as 
shown for Trenton by the 1940 U. S. 
Census, while for the variables of age 
and religious affiliation the difference 
was less than 13 per cent. There was 
not more than 16 per cent distortion be- 


1The writer wishes to acknowledge the assist- 
ance given in this research project by Miss 
Melita Seipp. 
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tween the group studied and the total 
population for the variable of occupa- 
tional class and about 20 per cent for 
educational level. The bias in the sam- 
ple was in favor of the higher educa- 
tional levels, upper occupational groups, 
and those of Protestant faith. These 
distortions should be considered in the 
reading of the paper. However, the data 
did reveal many consistent trends and 
apparently the sampling bias did not 
seriously influence the findings. 

The analysis reported herein for the 
age variables was based on the follow- 
ing age ranges: ages 18-35 (N=125), 
ages 36-60 (N=91), and ages 60-and- 
over (N=22). Religious affiliation was 
analyzed only for Protestant (N=98) 
and Catholic (N=115) adherents. The 
three classes used in the occupational 
breakdown are the laboring (N=116), 
white collar (N=92), and professional- 
business executive classes (N=23). The 
categories used for educational level 
are; no schooling to 4th grade (N=20), 
5-llth grades (N=121), and 12th grade 
and above (N=100). When significant 
differences are reported for these vari- 
ables, they are at the .95 level of confi- 
dence.*? Differences below this level are 
referred to as trends or tendencies. 


ESTIMATED INCIDENCE OF INSANITY 


Question 1 was intended to measure 
the accuracy of the group’s knowledge 


2Probabilities were estimated from confidence 
limits charts based on formulas prepared by 
S. S. Wilks and F. Mosteller [1, 3]. 
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concerning the incidence of “insanity” 
as measured by the admission rates for 
mental institutions. Question 1 was 
stated, “What per cent of the people in 
the U. S. do you think will be sent to a 
mental institution in their lifetime?” 
The 241 responses given to this ques- 
tion are presented in Table I. 


TABLE I 
RESPONSES TO QUESTION 1: “WHAT PER CENT 
OF THE PEOPLE IN THE U. S. Do You 
THINK WILL BE SENT TO A MENTAL 
INSTITUTION IN THEIR LIFETIME?” 


Number of al Per cent 
Responses (N—241) 


Responses 


1% or less ........ 32 


ceibinoninae 32 13% 
RAITT. sccncesmstandeltanilemthcacmaiidlin 109 45 
10% or more .................. 60 25 
tg 2, an 40 17 
; 241 100% 


It has been reported that about 6 per 
cent of the current population are ex- 
pected to require hospitalization for 
some type of nervous or mental illness 
at some time during their lives [2]. The 
writer of this report believes that, to 
the group sampled, the term, “mental 
institution” was interpreted to mean 
those hospitals caring primarily for pa- 
tients suffering from psychoses and oth- 
er forms of severe nervous or mental 
disorders. Bearing these facts in mind, 
let us turn to a study of the responses. 
Forty-five per cent of the estimates fell 
between the incidence figures of 2-10 
per cent, which were considered to be 
a fairly accurate estimate of the actual 
rate. Only 13 per cent of the respon- 
dents estimated the rate to be one per 
cent or less. A considerably larger 
group, 25 per cent, believed the hospi- 
talization rate to be over 10 per cent. 
Combining these two latter groups, it is 
seen that 38 per cent of the respondents 
made rather serious errors in their esti- 
mation of the incidence of insanity. Sev- 
enteen per cent of the respondents an- 


swered “Don’t know”. 

It thus appears that about half the 
population had a fairly accurate idea of 
the incidence of mental illness as meas- 
ured by hospital admission figures. One 
quarter of the people interviewed appre- 
ciably overestimated its incidence, and 
one-eighth underestimated it. 

The responses to Question 1 were then 
analyzed for the six background vari- 
ables. The findings for the variable of 
educational level are presented in Table 


II and those for occupational class in 
Table ITI. 


TABLE II 
EDUCATIONAL LEVEL 
Responses to Question 1: “What per cent of 
the people in the U. S. do you think will be 
sent to a mental institution in their lifetime?” 


GRADES 
12th 
0-4'th 5-11th and up 
Responses (N=20) (N=121) (N=—100) 
1% or less... 5% 8% 21% 
2-10% ........... 5 45 54 
10% or more .. 40 27 19 
Don’t know ... 50 20 6 
100% 100% 100% 


TABLE III 
OCCUPATIONAL CLASS 
Responses to Question 1:“What per cent of 
the people in the U.S. do you think will be sent 
to a mental institution in their lifetime?” 


White Profes- 





Labor Collar sional 
Responses (N=116) (N—92) (N=—23) 
1% or less ...... 8% ee 16% - 26% ; 
ee 40 50 61 
Over 10% ...... 32 22 4 
Don’t know .... 20 12 9 
100% 100% 100% 


At the two upper educational levels 
approximately one-half of the respon- 
dents gave an answer which was con- 
sidered to be a reasonably correct esti- 
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mate of the true incidence figure. Table 
II shows that the lower the educational 
level the more frequently the response 
“Don’t know” was given. When an esti- 
mate was made by the respondents 
from the two lower educational levels, 
it was usually an overestimation of the 
actual incidence rate. 

Table III reveals that about 60 per 
cent of the professional and business 
class made a fairly accurate estimate of 
the incidence as compared to 40 per cent 
for the lowest occupational class. The 
errors made by the laboring group were 
usually in the direction of an overesti- 
mation of the actual rate, while the er- 
rors of the professional and business 
group were usually underestimations. 

Summarizing, it can be said that re- 
spondents from the higher educational 
level and the higher occupational class 
more frequently gave the correct esti- 
mate for the incidence of insanity. Er- 
rors were usually overestimations for 
the lowest educational - occupational 
group, while they were underestima- 
tions for the higher educational-occupa- 
tional group. 

For the variable of the sex of the re- 
spondent, the findings reveal that mem- 
bers of both sexes gave the correct an- 
swer about the same number of times. 
However, when errors were made, it 
was found that men were more likely to 
underestimate the incidence of insanity, 
while women tended to overestimate it. 
Negro respondents and those from older 
age groups more frequently overesti- 
mated the true incidence when compared 
with white and younger groups respec- 
tively. Those respondents who were 
white, members of professional or busi- 
ness groups, and at the younger age, 
were the ones who most frequently gave 
an incidence figure which was consid- 
ered as a close approximation of the ac- 
tual rate. A breakdown according to 
Protestant and Catholic faith revealed 


that a slightly larger per cent of Catho- 
lics gave the correct estimation. 


ESTIMATED INCIDENCE AMONG MEN 
AND WOMEN 


Question 2 was asked in order to de- 
termine whether or not people believe 
that there is any difference in the inci- 
dence of “insanity” among men and 
women. The question was stated, “Do 
you believe there is any difference be- 
tween the number of men or of women 
who go insane?” Table IV presents the 
241 responses given to this question. 


TABLE IV 
RESPONSES TO QUESTION 2: “Do YOu BELIEVE 
THERE Is ANY DIFFERENCE BETWEEN THE 
NUMBER OF MEN OR OF WOMEN 
WHo Go INSANE?” 


Number of Per cent 





Responses Responses (N==241) 
More women .............. 99 41% 
About equal ................ 73 30 
 araeiee seoe 42 18 
ee re 27 11 
241 100% 


The actual incidence rate of insanity 
is reported to be approximately the 
same for men and women [2]. Table IV 
shows that 30 per cent of the respon- 
dents gave the acceptable answer 
“About equal’. Forty-one per cent of 
the responses, however, were statements 
that more women than men go insane. 
Under the heading “More men” fell 18 
per cent of the responses. The response 
“More women” was therefore given 
twice as frequently as “More men”. 
There were 11 per cent of the responses 
which fell in the category “Don’t know”. 

In a study of the reasons given for a 
particular opinion, it was found that 
usually both physiological and psycho- 
logical explanations were attached to 
the response “More women than men go 
insane”, whereas the basis for the opin- 
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ion that “More men” went insane rested 
primarily upon psychological explana- 
tions. Of the 25 people who amplified 
their answer “More women go insane”, 
there were 11 who stated that meno- 
pause was the cause. Seven respondents 
stated that females experienced greater 
“family strain’, “tension”, “worry” or 
“emotionality” than males, and there- 
fore more frequently developed insan- 
ty. The remaining 7 responses included 
statements such as “childbirth”, “‘be- 
cause of men”, and “through alcohol- 
ism”’. 

The reasons given for a greater inci- 
dence of insanity among men were quite 
scattered, but most of them referred to 
psychological factors. For example, 
there were explanations such as “men 
have more strain in life’, “men tend to 
become frustrated more easily”, “men 
more nervous”, “more worried”, “be- 
cause of business problems”, “more in 
contact with life’, “not sheltered”, “bur- 
den of being head of family”, and “war 
conditions”’. 


To recapitulate, it may be stated that 
about four out of every ten respondents 
believed that more women “go insane” 
than men, two out of ten that more men 
do, three out of ten believed the in- 
cidence is equal, and one out of ten gave 
no opinion. 


When the responses to this question 
were studied for the six background 
variables no significant differences were 
found. However, a few interesting 
trends appeared in the analysis. The 
Catholic and the white respondents gave 
a higher incidence of insanity among 
women than did the Protestant or the 
Negro respondents. Men rated the in- 
cidence figure higher for females than 
for males. Women made a similar over- 
estimation but at a percentage which 
was twice as large as that given by men. 


ESTIMATE OF DISCHARGE RATE 


Question 3, “Of those who are sent to 
a mental institution, what per cent do 
you think become well enough to 
leave?”, was asked in order to sample 
the accuracy of the group’s knowledge 
concerning the discharge rate for men- 
tal patients who have been institution- 


alized. Table V presents the 241 re- 
sponses given to this question. 
TABLE V 
RESPONSES TO QUESTION 3: “Or THOSE WHO 
ARE SENT TO A MENTAL INSTITUTION, 
WHAT Per CENT Do You THINK 
BECOME WELL ENOUGH 
TO LEAVE?” 
Number of Per cent 
Reposnse: Responses (N=—241) 
15% or less .. ‘adi 50 
16-20% . ~ 8 
25-44% . : 30 12 
45-59% ..... 43 18 
60% or more 40 17 
Don’t know .... 40 17 
241 100 


The National Committee for Mental 
Hygiene reports approximately 25 to 44 
per cent of all the patients in mental 
hospitals are discharged as recovered or 
improved [4]. On the basis of this re- 
port, all responses in this study which 
fell within the range of 25-44 per cent 
were considered very accurate estimates 
of the discharge rate for institutional- 
ized mental patients. A study of Table 
V reveals that only 12 per cent of the 
responses fall into this category. Those 
who either over or underestimated the 
25-44 per cent range by not more than 
ten to fifteen per cent constituted an- 
other 21 per cent of the respondents. 
Thus, the number who stated that the 
discharge rate fell between 16 and 59 
per cent was 33 per cent of the group 
interviewed. More simply, it can be 
stated that one out of every three re- 
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sponses given are somewhat in accord 
with the actual facts. 

About the same number of respon- 
dents, 33 per cent, gave an estimate of 
15 per cent or less. This is considered 
to be a gross underestimation of the ac- 
tual situation. About 17 per cent of the 
respondents placed their answers at the 
opposite extreme, stating that 60 per 
cent or more of those institutionalized 
would eventually be discharged. There 
were 17 per cent of the responses which 
fell into the “Don’t know” category. 

Thus it appears that although one out 
of every three people sampled had a fair 
knowledge of the discharge rate of in- 
stitutionalized mental patients, two out 
of every three seriously underestimated 
or overestimated this rate. 


TABLE VI 
EDUCATIONAL LEVEL 
Responses to Question 3, “Of those who are 
sent to a mental institution, what per cent do 


9? 


you think become well enough to leave? 





GRADES 











12th 
0-4th 5-11th and up 
Responses (N20) (N==—121) (N=100) 
Below 25% .... 30% 38% 36% 
25-44% 20 10 14 
Over 44% 15 35 38 
Don’t know . 35 17 12 
100% 100% 100° 
TABLE VII 


OCCUPATIONAL LEVEL 


Responses to Question 3, “Of those who are 
sent to a mental institution, what per cent do 
you think become well enough to leave?” 























White Profes- 
Labor Collar sional 
Responses (N=116) (N92) (N=23) 
Below 25% wt 1% 40% 18% 
25-44% ............ 10 14 17 
Over 44% ........ 32 34 52 
Don’t know ... 21 12 13 
100% 100% 100% 
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Again the responses were analyzed 
according to the six variables previously 
described. For each of the variables 
there was a greater percentage of an- 
swers in both the over and underesti- 
mation categories than there was in the 
25-44 per cent range. The findings for 
educational level and occupational class 
are given in Tables VI and VII. 

The data in Table VI show that the 
lowest educational level group (0-4th 
grade) responded “Don’t know” more 
frequently than the two higher levels. 
When an estimation was made by the 
lowest group, it tended toward an un- 
derestimation. The errors in estimation 
of the two upper levels were approxi- 
mately equal in both directions. 

In Table VII the breakdowns for the 
laboring and white collar occupational 
groups reveal that they tend to under- 
estimate the discharge rate, while those 
from the professional and business class 
show a tendency to overestimate the 
rate. 

The remaining four variables show 
distinctive trends, but none are of suf- 
ficient magnitude to be statistically sig- 
nificant. The background variable of 
sex revealed that men had a tendency 
to overestimate the discharge rate, while 
women tended to underestimate it. 
White respondents seem better informed 
than Negroes. The variable for age 
shows approximately the same percent- 
age for the overestimations and the un- 
derestimations at each age level. A 
slightly larger per cent of Catholics 
than Protestant respondents underesti- 
mated the actual figure. 


SUMMARY 


A public opinion survey aiming to ob- 
tain estimates of the incidence and dis- 
charge rates for hospital cases of men- 
tal illness was administered individual- 
ly to 241 people in Trenton, New Jersey. 

A fairly accurate estimate of the in- 
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cidence of mental illness was made by 
approximately 50 per cent of the re- 
spondents. Errors were more frequent- 
ly overestimations than underestima- 
tions of the actual rate. The incidence 
of insanity among men and women was 
correctly reported as “about equal’ by 
only 30 per cent of the respondents, 
higher among women by 41 per cent, 
and higher among men by 18 per cent. 
About one-third of the respondents made 
a fairly accurate estimate—between 16 
and 59 per cent—of the discharge rate 
for hospitalized mental patients. There 
were twice as many estimates below this 
range as above it. 


The analysis of the responses to each 
of these questions was made for the 
background variables of sex, age, race, 
educational level, and occupational class. 
Significant differences were found most 
frequently for the educational and occu- 
pational variables. The higher the edu- 
cational and occupational level the more 
frequently accurate estimates were ob- 
tained. 

Overestimations of the incidence rate 
and underestimations of the discharge 
rate were made more frequently by 
women and by those respondents in the 


lower educational - occupational level. 
The opposite trend in estimations was 
found for men and for those in the high- 
er educational-occupational groups. The 
findings for Negro and older respond- 
ents were similar to those found for low 
educational-occupational groups. Analy- 
sis according to religious affiliation 
showed small and unimportant trends. 


Received September 20, 1948. 
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HILE reading disability cases 
Av.S are fairly frequent in school 
situations, and while they constitute a 
considerable percentage of the problems 
seen at an educational clinic, it is com- 
paratively seldom that they turn up at 
and:are routinely handled by a mental 
hygiene clinic. At the Northern New 
Jersey Mental Hygiene Clinic, however, 
it has been a routine practice for the 
past ten years to diagnose reading dis- 
ability cases among the varied patients 
of the clinic, and to attempt a regular 
mental hygiene approach to the prob- 
lems presented by children who have a 
specific reading disability. 

The clinic procedure in regard to 
reading disability cases is as follows. 
Whenever a child’s school or home rec- 
ord contains evidence of his having a 
reading disability, or whenever such evi- 
dence is revealed in the course of the 
routine psychological examination 
which is given every clinic patient (in- 
cluding the Stanford Binet and the Tra- 
bue Completion Test), a special diag- 
nostic reading examination is given. 
This examination includes Gray’s Oral 
Reading Examination, the Stanford 
Achievement Test, oral reading of 
twenty special palindromic words, 
oral reading of the letters of the alpha- 
bet, and whatever other reading tests 
are deemed necessary in individual 


1This study was done under the direction of, 
and with the advisory help of Dr. Earl W. 
Fuller, Director of the Northern New Jersey 
Mental Hygiene Clinic. 


RESULTS OF A MENTAL HYGIENE APPROACH TO 
READING DISABILITY PROBLEMS 
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HOSPITAL, GREYSTONE PARK, N. J. 


cases. If, on the basis of these tests, the 
child is found to have a specific reading 
disability, he is diagnosed as a reading 
disability case ( in addition to whatever 
other diagnosis is made in his case), 
and this diagnosis is taken into consid- 
eration in the planning of his treatment. 

Since the clinic is not itself equipped 
to do remedial reading tutoring, treat- 
ment takes place along fairly conven- 
tional mental hygiene and child guid- 
ance lines. That is to say, each reading 
disability case is assigned to a social 
worker who acts as the chief guidance 
and therapeutic agent, under the direct 
supervision of a psychiatrist. In cases 
where the problem presented seems to 
be purely of an educational nature, the 
social worker alone will usually work 
with the child and his parents; in cases 
where emotional problems are also pre- 
sented, the psychiatrist will also see the 
child for one or more sessions. It is the 
social worker’s task to attempt to ar- 
range for suitable remedial reading tu- 
toring for the child by exploring and 
utilizing the best available resources of 
the home, the school, and the commu- 
nity. The psychologist, who draws up 
a detailed plan of remedial reading in- 
struction for each patient, usuallv rec- 
ommends that tutoring be done on an 
individualized basis, by a sympathetic 
tutor, during regular school hours, for 
at least a half-hour a day. It is the so- 
cial worker’s task (among other things) 
to try to see that the psychologist’s plan 
is carried out as fully and accurately as 
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possible. Moreover, if and when a spe- 
cial tutor is arranged for, the social 
worker generally confers with him 
about the remedial reading plan, and 
preferably encourages him to go over 
the plan and the patient’s progress with 
the psychologist. At the same time, at 
her own discretion, the social worker 
carries the case on a regular therapeu- 
tic basis, and attempts to do everything 
possible to relieve home, neighborhood 
and school tensions on the child, so that 
he may function in a maximally efficient 
and happy manner. (In these functions, 
it may be parenthetically remarked, she 
is often limited by the extra-heavy case 
loads which seem to be a common dis- 
ease of contemporary child guidance 
clinics. ) 

After the social worker has carried 
the case for a time and has arranged for 
some kind of tutoring in remedial read- 
ing for a given child, another psycho- 
logical appointment is given the child 
and a reading re-check is made, to de- 
termine what reading progress, if any, 
has been made. As a result of this re- 
check, the psychologist modifies the 
original remedial reading plan in ac- 
cordance with the latest diagnostic find- 
ings, and the social worker is again giv- 
en the responsibility of seeing that the 
modified plan is carried out in the best 
possible manner. Periodically, there- 
after, until the case is finally closed, psy- 
chological re-checks are done and reme- 
dial reading plans reformulated as 
deemed necessary. Meanwhile, the so- 
cial worker, under psychiatric and psy- 
chological supervision, and sometimes 
in conjunction with psychiatric consul- 
tations on the part of the child and his 
parents, continues to carry on the case 
in a regular mental hygiene manner. 

In order to check the results of this 
type of treatment of reading disability 
problems, the files of the Northern New 
Jersey Mental Hygiene Clinic for the 


years 1945 to 1948 were searched for 
all reading disability cases. Two hun- 
dred and thirty-three cases of this type 
were located. Of these, one hundred 
cases were available where the original 
diagnosis of reading disability had been 
made and where a psychological re-ex- 
amination, approximately a year after 
the original one, had also included a 
battery of reading diagnostic tests. 
Since all these cases had been diag- 
nosed and handled in the same kind of 
way, and since a quantitative check on 
the amount of reading gain over a 
year’s time was available in each, it was 
decided to see what the correlates of 
this reading gain were. Were, for ex- 
ample, the reading gains (or lack of 
gains) by the patients related to the 
amount and quality of the remedial tu- 
toring they received? to the number of 
times the social workers visited their 
homes and their schools? to their intel- 
ligence? to the severity of their emotion- 
al problems? Questions like these were 
the starting points of the present study. 

Procedurally, the study was done by 
reading through the case histories of 
each reading disability problem and not- 
ing the amount of tested reading gain 
during the child’s first year of contact 
with the clinic, the amount of his origi- 
nal reading retardation, the number of 
social: worker visits to his home and to 
his school, the number of psychiatric 
consultations, the patient’s age at the 
time of the reading disability diagno- 
sis, his term in school, and the number 
of years he was retarded in school. 

In addition, four ratings were made 
for each child: (1) the amount and 
quality of the remedial tutoring received 
by the child during the year was rated 
on a scale from 1 (little or no tutoring) 
to 4 (regular tutoring on an individual 
basis). (2) The adequacy of the child’s 
school work, as reported by his school, 
was rated on a scale from 1 (failing) 
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through 2 (unsatisfactory) to 3 (vari- 
able or satisfactory). (3) The severity 
of the psychiatric diagnosis (as made 
by the psychiatrist or psychologist or 
both) was rated on a scale from 1 (edu- 
cational problem, with no undue emo- 
tional disturbance) through 2 (mild 
emotional problem) to 3 (severe emo- 
tional problem). (4) Intelligence ra- 
tings, in accordance with the regular 
psychological diagnoses of the clinic, 
were given as follows: 1—inferior intel- 
ligence; 2 — low average intelligence; 
3—average intelligence ; 4—high average 
intelligence; 5—superior intelligence. 

Using the above quantitative data and 
ratings based on the case history ma- 
terial, Pearsonian coefficients of corre- 
lation were calculated between the 
amount of reading gains made by the 
patients during their first year’s contact 
with the clinic and the stipulated other 
variables which were empirically ob- 
observed. 


THE FINDINGS 


The data dealing with the measures 
of central tendency and variability for 
those experimental variables which 
could be directly quantified are record- 
ed in Table I. Analogous data for the 
experimental variables which were in- 
directly quantified by means of the ra- 
ting procedure described above are list- 
ed as follows: 

Amount and quality of remedial read- 
ing tutoring: Nineteen of the patients 
received little or no tutoring during 
their first year of clinic contact; 28 re- 
ceived some tutoring, but usually on a 
classroom and fairly haphazard basis; 
27 received some individual and some 
classroom tutoring on a fairly satisfac- 
tory basis; and 26 received individual 
remedial tutoring on a satisfactory ba- 
sis. 

Adequacy of school work: Thirty-one 
of the patients, at the time of being 


TABLE I 
MEASURES OF CENTRAL TENDENCY AND VARI- 
ABILITY FOR CERTAIN OF THE EXPERI- 
MENTAL VARIABLES 








Variables 


Range Mean “Median S.D._ 








Reading gain after one year 


of casework (in years)...... 0-2.4 7 6 5 
Amount of original reading 
retardation (in years)... 0-4,2 1.6 1.5 1.3 


Number of social worker 


visits to the home..... 0-22 4.0 4 4.) 
Number of social worker 
visits to the school... 0-12 4.7 5 5.1 
Number of psychiatric con- 
sultations during year 0-4 5 0 7 
Age at time reading dis- 
ability was diagnosed 7-14 9.0 y 1.8 
Term reached in school at 
ime reading disability 
was diagnosed bes . 1-7 3.6 3 1.5 
r of years retarded 


ool at time reading 


lisability was diagnosed 0-3 8 1 6 


diagnosed as reading disability cases, 
were failing in their school work; 51 
were doing unsatisfactory work in 
school; and 18 were doing variable or 
satisfactory school work. 

Severity of psychiatric diagnosis: 
Forty-eight of the children were diag- 
nosed by the clinic personnel as being 
educational problems, with no undue 
emotional disturbance; 28 were diag- 
nosed as mild emotional problems; and 
24 as severe emotiona! problems. 

Intelligence ratings: Six of the pa- 
tients were diagnosed as having infer- 
ior intelligence; 7 as having low aver- 
age intelligence; 42 as having average 
intelligence; 29 as having high average 
intelligence; and 15 as having superior 
intelligence. 

From the above information and the 
data of Table I, it can be seen that the 
average child diagnosed by the clinic as 
being a specific reading disability prob- 
lem was a year and a half retarded in 
his reading, was nine years old, was in 
the third grade, was one year retarded 
in school, had average intelligence, was 
mildly emotionally disturbed, and was 
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doing unsatisfactory work in school. 
This average child, after having his 
home visited four times and his school 
visited five times by the social worker 
during his first year of clinic contact, 
and after having some classroom and 
some individual remedial reading tutor- 
ing of a semisatisfactory type, made a 
reading gain over the year’s time of a 
little more than a half year. 

The coefficients of correlation between 
the amount of reading gains made by 
the hundred children studied and the 
stipulated other variables of the study 
are listed in Table I]. An examination 
of the data of Table II reveals the fol- 
lowing points: 


TABLE Il 
COEFFICIENTS OF CORRELATION BETWEEN 
AMOUNT OF READING GAIN AND STIP- 
ULATED OTHER VARIABLES 





Coefficient of 











Variable Correlation 
Amount and quality of remedial 
I TIO aisncssitcicesenctveenincens .62** 
Intelligence ratings of subjects ...... -_ 
Severity of psychiatric diagnosis ... —.33** 
Age at time reading disability 
Ws GIONS enw BY fos 


Number of years retarded in school 

at time reading disability 

lt GEE © oe ec ce —.16 
Term reached in school at time 

reading disability was diagnosed 13 
Number of social worker visits to 

SE OIND . ccestaxcniedumibicrens dahil: 12 
Severity of original reading re- 

tardation 
Quality of school work at time 

reading disability was discovered —.08 
Number of social worker visits to 

I ND cnchcccascopieinasacestiacenee. ——.07 
Number of psychiatric consulta- 

tions during the year .................... —.07 


**Significantly different from zero at the .01 level of 
confidence. 





1. By far the most substantial de- 
gree of correlation exists between read- 


ing gain and the amount and quality of 
remedial reading tutoring. Evidently, 
the better and more individualized the 
tutoriag is, the more reading gain the 
patients tend to make. 

2. The intelligence of the patients 
seems to have a definite influence on the 
reading gains that they make, with the 
more intelligent subjects tending to 
make the greater gains. 

3. The severity of psychiatric diag- 
nosis is inversely related to reading 
gains of the patients: that is to say, the 
more emotionally disturbed they are, 
the less their reading seems to improve. 

4. There is an association between 
the patient’s age and their reading 
gains: so that the older the children are 
at the time of the original diagnosis of 
reading disability, the more they tend 
to gain by a year’s remedial reading 
tutoring. 

While these four relationships be- 
tween reading gain and tutoring, intel- 
ligence, psychiatric diagnosis, and the 
patient’s age are all statistically signifi- 
cant, none of the coefficients of corre- 
lation is very high. There is, moreover, 
no certainty that the correlational find- 
ings are proof of cause and effect rela- 
tions, since it is possible that some other 
unknown common factors are involved 
here. Nonetheless, until more plausible 
hypotheses in this connection are pre- 
sented, it does seem likely, on the basis 
of the experimental data, that there is 
some definite tendency for these clinic 
patients to make reading gains in direct 
proportion to the amount and quality of 
remedial reading tutoring they receive, 
in proportion to how intelligent they 
are, in proportion to how mild their 
emotional disturbances are, and in pro- 
portion to how old they are at the time 
their reading disability is discovered. 

The remainder of the correlational 
evidence in Table II is, at best, only sug- 
gestive. It suggests, and then to only 
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a slight extent, that clinic patients make 
more reading gains when they are less 
retarded in school, when they have 
reached higher classes, when the social 
worker makes more visits to the school, 
when they are doing relatively poor 
work in school, when their original read- 
ing retardation is relatively severe, 
when there are relatively fewer social 
worker visits to the home, and when 
there are fewer psychiatric consulta- 
tions. 


DISCUSSION 


There are certain consistencies about 
the obtained data which seem to war- 
rant highlighting. It can be seen, for 
example, that the clinic patients tended 
to make less reading gains when they 
were severely disturbed emotionally, 
and also when there were relatively 
more social worker visits to the home 
and more psychiatric consultations. 
Naturally, though, the last two points 
are at least in part a function of the 
first one, since where the children are 
more emotionally disturbed, there will 
tend to be more social worker visits to 
the home and more psychiatric consul- 
tations. 

It can be seen, again, that the older 
the children were, the higher term in 
school they had reached, and the more 
retarded in reading they were, the 
greater reading gains they tended to 
make. Here, too, reaching a higher 
term in school and being more retarded 
in reading seem, at least in part, to be 
a function of being older. 

It can be seen, too, that the more in- 
telligent the subjects were, the greater 
their reading gain tended to be; and the 
more retarded they were in school, the 
less their reading gain tended to be. But 
being more retarded in school is par- 
tially, no doubt, a function of being 
relatively unintelligent. 

Once more, it can be seen that the 


amount of the children’s reading gain 
was related to (@) the amount and qual- 
ity of remedial reading tutoring they re- 
ceived and (b) the number of social 
worker visits to the school. But, as was 
especially obvious from reading the case 
histories, the amount and quality of the 
tutoring was often the result of the per- 
sistent school visits of the social worker. 

The relationships shown in Table II, 
therefore, seem logically to boil down to 
the first four significant correlations in 
the table, to which virtually all the re- 
maining correlations seem to be at least 
in part dependent. There would conse- 
quently seem to be more than slight 
grounds for believing that highly sig- 
nificant, and probably, causal, relation- 
ships exist between these four variables 
and the patients’ reading gains. Simply 
stated, it would appear that the clinic 
had its greatest successes with reading 
disability cases who received adequate 
tutoring, who were relatively intelli- 
gent, who were not severly disturbed 
emotionally, and who were relatively 
older.? 

The results of the present study tend 
to throw some additional light on the 
problem of a possible emotional factor 
in reading disability. In general, there 
are two schools of thought on this prob- 
lem. On the one hand, there is consid- 
erable evidence to show that there is an 
important emotional factor in many, if 
not most, reading disability cases. Sup- 
porting data in this connection have 
been published by Blanchard [2], Chall- 
man [3], Gann [4], Hosey [6], Liss 
[8], Sperry [10], Zirbes [11] and oth- 
ers. On the other hand, Bennett [1] 
and Ladd [7] have published data which 


2The age factor may be exaggerated here, 
since the criterion of reading gain is measured, 
absolutely, in years, rather than _proportion- 
ately to years (as the Stanford-Binet 1.Q. is 
measured). It is doubtful, however, whether a 
reading quotient, equivalent to an intelligence 
quotient, is (in view of current diagnostic read- 
ing tests) a very meaningful concept. 
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tend to show that there are few signifi- 
cant differences, as far as emotional dis- 
turbances are concerned, between good 
and poor readers; and Gates [5] and 
McCullough, Strang, and Traxler [9] 
have pointed out that where emotional 
factors and reading difficulties do go 
hand in hand, it is difficult to tell wheth- 
er the emotional problems are a cause 
or a result of the reading disabilities. 

The inferences may be logically drawn 
from the data of the present study that 
(a) there are emotional factors in many 
(if not all) reading disability cases; 
but that (b) these are inextricably 
linked with educational, intellectual and 
other factors; so that any concerted and 
effective attack that is to be made on 
reading disabilities must be made from 
a well-rounded emotional - educational 
viewpoint. Reading disability, though 
specific enough in one sense, is really an 
organismic problem, and effective treat- 
ment would seem to involve the total 
personality of the child rather than 
some set of particular sensory or intel- 
lectual faculties. 


SUMMARY 


One hundred reading disability cases 
which were treated by a regular mental 
hygiene clinic procedure were studied to 
see what were the correlates of reading 
gains over the period of a year. It was 
found that significant coefficients of 
correlation existed between reading 
gains made during the year and (a) the 
amount and quality of remedial reading 
tutoring afforded the child; (b) the in- 
telligence rating of the child; (c) the 
severity of the psychiatric diagnosis; 
and (d) the child’s age at the time the 
reading disability was diagnosed. It was 


concluded that both educational and 
emotional factors seem to be of vital im- 
portance in the etiology of reading dis- 
abilities, and that the most effective at- 
tack upon them must be made on a con- 
certed educational-emotional basis. 


Received September 24, 1948. 
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A TIME AND MOTION STUDY OF HAND SCORING 
THE INDIVIDUAL MINNESOTA MULTIPHASIC 
PERSONALITY INVENTORY 


By RAYMOND J. CORSINI 


UNIVERSITY OF CALIFORNIA 


HE combined factors of the clini- 
é i cal usefulness of the Minnesota 
Multiphasic Personality Inventory and 
the formidable tasks of scoring and pro- 
filing the individual card form of this 
test, have resulted in the production of a 
substantial literature of six items [1, 2, 
3, 4, 6, 7] on the very esoteric problem 
of scoring this test in a more efficient 
manner. Three of the six contributions 
have appeared in this JOURNAL. The 
short-cut methods cited above tend to be 
of two types: either they involved addi- 
tional material, such as key-sorts or 
punched cards, or they used various for- 
mulas to obtain final scores. Some of 
these methods would be unsatisfactory 
for research purposes, since no record 
of the individual responses for the pur- 
pose of establishing new keys is pos- 
sible. While not all authors report the 
amount of saving possible, some of the 
writers suggest that the complete scor- 
ing can be done, with the help of the 
new method, in. contrast to Hathaway 
and McKinley’s orthodox method, in a 
minimum of ten minutes. 

The problem posed here is the follow- 
ing: just how long does it take to 
“score” the MMPI, from taking the 
cover off a completed box to the drawing 
of the profile? The author has asked 
several psychologists how long it takes 
them, or how long they believe it would 
take a competent experienced clerk. 
The median time given for the entire 
process by these judges’ was thirty-five 
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minutes. The writer finds this process 
takes him about forty-five minutes. In 
view of this, the advantage of shortcut 
methods is seen. 

The following report is based on two 
psychological technicians A.B. and C.D. 
A.B. had scored over 1000 MMPI’s over 
a period of four years. He was observed 
with a stop watch for ten randomly se- 
lected successive boxes. Times for the 
complete scoring operation varied from 
‘f five minutes and 41 seconds to 
a high of eleven minutes and nine 
onds. Each box was checked for accu- 
racy, and fewer than one error per box 
was found. 

The second scorer, C.D., was instruct- 
ed by A.B. in his method, and one sam- 
ple of his scoring was timed at the end 
ch week for 16 successive weeks. 
His weekly scoring assignment averaged 
twelve boxes. Emphasis was put on ac- 
curacy. Random spot checks for accu- 
racy were made from time to time. A 
moving average of three for these 16 
weeks gave the following times: 30-32- 
31-26-22-19-17-16-15-11-10-12-15-13. 

T I is a time and motion descrip- 


a low ¢ 


~ 


sec- 


of ea 


Table 
tion of a sample box scored by A.B. 
Timing was started with A.B. at his 
desk. The box is in front of him, the 
packet of keys and the sheet of norms 
are at his left, and the response sheet 
is thumb-tacked to the desk at his right. 
Extra equipment consists of a pencil 
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10. 


. Pull out “cannot say” 


. Count 


. Using plastic “K’ 


TABLE I 


Cumula- Opera- 


Scorer A.B. 


cards and count them .... 


. Record “cannot say” 


cards on the profile 
sheet by drawing a 
horizontal blue line in 
the proper spaces, han- 
dling cards with left 
hand and recording 
with right hand ............ 
temove “true” cards, 
separate into two seg- 
ments 


. Remove “false” cards, 


separate into two seg- 
ments 


. Record “true” abberant 


cards by making a red 
cross in the proper 
spaces with the right 
hand, working the cards 
with the left hand........ 


. Do the same as no. 5. 


with the “false” cards 
the “lie” score 
and register it on the 
sheet 


, 
scale, get K score and 
record 


. Do same for F, Hs, D, 


Hy, Pd, Mf, Pa, Pt, Sc, 
and Ma scales .............. 
Transfer raw scores 
from right edge of re- 
verse side to front of 
profile sheet . 


11. Add “K” seale factors 


13. 


. Using typewritten list 


of conversion norms 
change to T scores...... 
Draw psychogram, us- 
ing clear plastic ruler.. 


HAND SCORING THE MMPI 


TIME AND MOTION DESCRIPTION OF THE 
SCORING OF THE MMPI 


tive tion 
time time 
10 10 
35 25 
1-10 35 
1-35 25 
2-53 1-18 
8-46 53 
8-50 4 
4-08 18 
6-50 2-42 
7-13 23 
7-33 20 
8-38 1-05 
9-03 25 
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with red lead at one end and a blue 
lead at the other, and a typewritten list 
of conversion norms. 

This typical performance was made 
without errors. The conclusion is that 
scoring the MMPI in the normal stand- 
ard manner as outlined by Hathaway 
and McKinley is not as formidable a 
task as it appears, and that a skilled 
clerk can score from four to five boxes 
per hour with acceptable accuracy. In 
clinics where a relatively small number 
of MMPI tests are given, there would 
appear to be no advantage to use the 
more elaborate short-cut methods. 


Received September 29, 1948. 
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ALEXANDER, FRANZ AND FRENCH, THOMAS M. 
(Eds.) Studies tn psychosomatic medicine. 
New York: Ronald, 1948. Pp. xiii + 568. 
7.50. 

This seems to be the most useful volume yet 
available for the orientation of psychologists 
and advanced students to the entire field of 
psychosomatic disorders. Except for a brief 
but important introduction by Alexander, the 
book consists of 34 articles by 20 authors, 
which appeared in psychiatric journals from 
1984 to 1947. Following a general introduction 
to the principles of psychosomatic disorders, 
there are sections dealing with gastrointesti- 
nal, respiratory, cardiovascular, endocrine and 
metabolic, skin, joint and muscle, and miscel- 
laneous disturbances. The component articles 
contain numerous illustrative case studies; 
many have useful bibliographies. The view- 
point and style are singularly harmonious for 
a symposium by so many contributors, a uni- 
formity attributable to allegiance to the Chi- 
cago school of psychoanalysis. 


BELL, JOHN E. Projective techniques. New 


York: Longmans, Green, 1948. Pp. xvi + 
533. $4.50. 


Teachers of clinical psychology will greet 
this text with unrestrained and well justified 
enthusiasm. It is an answer to their need for 
a comprehensive, clear, and sound book on pro- 
jective methods, and a better answer to this 
need than might have been expected at the 
present time. Bell covers all types of projec- 
tive diagnosis under a fourfold classification: 
word-association (including incomplete sen- 
tences), visual stimulus techniques (Rorschach, 
TAT, and others), expressive movement, and 
play and drama. The administration and ele- 
ments of scoring and interpretation of each 
technique are described in sufficient detail to 
serve as an introductory manual. As the most 


highly developed methods, the Rorschach (127 
pages, 798 references) and the TAT (46 pages, 
91 references) receive the most extended de- 
scription. Less well known devices are repre- 
sented, however, including the Szondi, Mira 
Myokinetic, and Bender Gestalt. An almost in- 
evitable shortcoming, that many interpreta- 
tions are included without strict evidence for 
their validity, is more the fault of the field 
than of the author. There is a clear aware- 
ness of needs for further research, evident 
both in the sections on the validity of each test 
and in the generally cautious tone of the dis- 
cussions. Many aspects of the volume make it 
a valuable reference for experienced workers 
as well as for students—the descriptions of 
several techniques hitherto available only in 
journals; the Rorschach tables comparing Ger- 
man, French and English scoring, and sum- 
marizing the scoring of normal details by 
Klopfer, Beck and Hertz—to cite only a few. 


3UHLER, CHARLOTTE, BUHLER, KARL AND LE- 
FEVER, D. WELTY. Development of the basic 
Rorschach score, with manual of directions. 
Rorschach Standardization Studies No. 1. 
Hollywood, Calif.: Charlotte Buhler, 4759 N. 
Hollywood Blvd., 1948. Pp. ix + 190, mime- 
ographed. 


Clinical acumen and statistical discipline 
combined to procure this study of the quantifi- 
cation of the Rorschach. A list of 102 diag- 
nostic signs was developed in an attempt to 
differentiate among groups ranging from nor- 
mals to schizophrenics. By statistical proce- 
dures, positive and negative weights were at- 
tached to each sign, yielding an algebraic total 
designated as the Basic Rorschach Score (BR). 
Such scores appear to discriminate significant- 
ly among clinical groups, and further, to rank 
the groups in the order of the severity of per- 
sonality disturbance shown. Evidence is pre- 
sented that a single variable, referred to as 
personality integration or disintegration, af- 
fects the character of the diagnostic signs. 
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Consequently, BR scores may be interpreted 
in terms of four levels of integration: ade- 
quacy, conflict, impairment, and reality loss. 
While BR scores cannot be used for individual 
diagnosis, they may serve to exclude syndromes 
that do not apply, and may assist in gauging 
the level of adjustment. If further study sus- 
tains the validity of the BR scores, their con- 
venience will increase the utility of the Ror- 
schach in research. Despite minor flaws, the 
BR represents a forward stride in the difficult 
task of expressing significant aspects of per- 
sonality functioning in quantitative terms. The 
manual includes instructions for administering 
and scoring, sample cases, a description of the 
statistical procedures employed, and data on 
reliability and validity. 


GOLDSTEIN, NAOMI F. The roots of prejudice 
against the negro in the United States. Bos- 
ton: Boston Univ. Press, 1948. Pp. ix +213. 
$2.50. 


Racial prejudice is found to arise from mul- 
tiple causes, and not to be explained by single 
approaches, whether psychoanalytic, economic, 
political or sexual. The combatting of preju- 
dice is not accomplished merely by the promo- 
tion of warmer attitudes toward minority 
groups, but by the development of genuinely 
non-racist thinking. This dissertation was pub- 
lished as a memorial to Dr. Goldstein, a bril- 
liant young women who was killed in an acci- 
dent in 1946 at the age of twenty-six. 


KRECH, DAVID AND CRUTCHFIELD, RICHARD S. 
Theory and problems of social psychology. 
New York: McGraw-Hill, 1948. Pp. xv + 
639. $4.50. 


Krech and Crutchfield present the first ex- 
plicitly systematic account of “field” theory in 
relation to the problems and applications of so- 
cial psychology. The textbook is divided into 
three parts. Part one, basic principles, holds 
considerable interest for general and clinical 
psychologists as well as for specialists in the 
social area. In it, principles of motivation, 
perception and learning are developed as a se- 
ries of fourteen propositions. Motivation is 
treated as molar behavior determined by the 
immediate psychological field. The entire the- 
ory is so fully perception-oriented that learn- 
ing is described as “reorganizing our percep- 
tions.” Part two, social processes, takes up 
beliefs, attitudes, public opinion research, pro- 
paganda, social groups, morale and leadership. 
In part three, applications are made to prob- 


lems of racial prejudice, industrial conflict and 
international tensions. 


LEUBA, CLARENCE. Ethics in sex conduct. New 
York: Association Press, 1948. Pp. 164. 
$2.50. 


Subtitled “a manual on youth, sex, and mar- 
riage,” this small book is intended to help 
young people develop their own standards in 
the sexual area. Its calm attitude, its rather 
full content of information, and its emphasis 
on the need for each young person to work 
out his own code, commend the book for use 
with marriage guidance classes, or for indi- 
vidual reading in connection with counseling. 
PoLLAK, OTTO AND HEATHERS, GLEN. Social 
adjustment in old age, a research planning 
report. New York: Social Science Research 
Council, Bulletin 59, 1948. Pp. xi + 199. 
$1.75 


The increased proportion of elderly persons, 
and the new problems that they present in an 
industrial culture, led the Social Science Re- 
search Council to plan a broad program of re- 
search on later maturity and old age. This 
monograph defines the problems, proposes a 
frame of reference for research, and outlines 
projects in areas of individual adjustment, 
family, occupation, and retirement. There is 
a bibliography of 387 titles. 


Ray, MArrie B. How to conquer your handicaps. 
Indianapolis, Ind.: Bobbs-Merrill, 1948. Pp. 
336. $3.00. 


A popular book, mainly of vivaciously told 
anecdotes about people who overcame handi- 
caps to rise to superiority. The thesis that 
everyone succeeds because of a handicap is 
super-Adlerian, but the volume may bring 
some consolation or inspiration to readers with 
infirmities. An appendix gives a list of reput- 
able agencies that serve handicapped persons. 


TESTS 


AMMONS, RosBert B. AND AMMONS, HELEN S. 
Full-Range Vocabulary Test. Ages 2-adult. 
Individual test. 2 forms. Untimed (10) min. 
16 plates ($5.00), with directions and norms, 
pp. 2; answer sheets. New Orleans, La.: R. 
B. Ammons, Tulane Univ., 1948. 


In this ingenious new form of vocabulary 
test, the examinee responds by indicating which 
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of four pictures on a plate represents a word 
spoken by the examiner. It can therefore be 
used with subjects who cannot verbalize well 
and with the severely handicapped, such as 
spastics, who can only nod or make an unintel- 
ligible sound. A series of words is used with 
each of the 16 plates, sharply scaled in diffi- 
culty (as, for example, from pie to egress). 
Two forms of the test each use 85 different 
words with the same plates. Provision for pre- 
sumed passes of easy words, and presumed 
failures of difficult ones, reduces the number 
of words administered to any one subject. Pre- 
liminary age norms for children and percen- 


tile norms for adults are reported for 592 
cases. 


Bowers, Henry. Manual Descriptive of the 
Aptitude Test for Elementary School Teach- 
ers-in-Training. Revised manual, pp. 47, 
($1.50 with unit set of tests). Toronto, Ont.: 
J. M. Dent & Sons (Canada) Ltd., 1948. 


\ revised and extended manual for a test 
previously reviewed (J. consult. Psychol., 1948, 
12, 62). The manual describes the develop- 
ment, validity, reliability, administration, scor- 
ing and interpretation of the test. 


GRAVES, MAITLAND. Design: Judgment Test. 
High school-adult. 1 form. Untimed (20-30) 
min. IBM or hand scoring. Design book of 
90 plates ($1.75); IBM answer sheets ($1.50 
per 50), with key and manual, pp. 4. Speci- 
men set ($1.85). New York: Psychological 
Corporation, 1948. 


The counselor’s limited resources for meas- 
uring art aptitude are augmented by this test, 
which uses a new approach. Each plate has 
two or three designs of entirely novel and ab- 
stract character, so that judgment is relative- 
ly uninfluenced by familiarity or by subject- 
matter association. The “right” design of each 
set is organized in accordance with basic prin- 
ciples of aesthetic order — unity, dominance, 
variety, balance, continuity, symmetry, propor- 
tion, rhythm—while the other design or de- 
signs violate one or more of these principles. 
The selection of items was confirmed by the 
agreement of trained artists, and by internal 
consistency with the whole test. The median 
reliability is reported as .86. Validity is dis- 
cussed in terms of the capacity of the test to 
separate groups such as students majoring in 
art and nonart curricula. This validation does 
not distinguish between aptitude and achieve- 
ment, and further validation studies involv- 


ing prediction are proposed. Percentile norms 
are given for art and nonart college and high 
school students, the college norms on about 
1,000 cases and the high school norms on about 
150. 


GREENE, H. A. AND BALLENGER, H. L. Jowa 
Language Abilities Test. 2 levels: elemen- 
tary, grades 4-7; intermediate, grades 7-10. 
8 forms at each level. 48-46 (60) min. IBM 
or hand scoring. Test booklets (elem., $1.70 
per 25; inter, $2.30 per 25), with directions, 
keys, class record. Manual for interpreting, 
pp. 32, (25¢). Yonkers, N. Y.: World Book 
Co., 1948. 


This test samples the language skills of pu- 
pils at the upper elementary and junior high 
school levels. The Elementary Test consists of 
five parts: spelling, word meaning, language 
usage, capitalization and punctuation. The In- 
termediate Test contains these five, plus sen- 
tence sense and grammatical form recognition. 
Each subtest score is converted into a standard 
score, permitting the drawing of a profile. Per- 
centile norms, for grades 4 through 10, and 
grade-equivalent scores, are provided for the 
total score and for each subtest, based on an 
unstated but presumably fairly large number 


£ 


of cas 7 


ss drawn from 17 communities. Subtest 
reliabilities range from .60 to .96, with a ma- 
jority over .90. The manual gives many sug- 
gestions for the use of test results for improv- 
ing pupil achievement. 


KING, JosEPH E. Factored Aptitude Series. 
Adult, industrial. 14 tests, 1 form of each: 
office-, sales-, scientific-, and mechanical 
terms, tools, judgment, differences, numbers, 
perception, precision, fluency, memory, di- 
mension, motor. 5 (7) min. each test. Test 
booklets ($6.75 per 50, each test), with man- 
ual, keys, sold by contract. Specimen set 
($2.00). Chicago: Industrial Psychology, 
105 W. Adams St., 1947, 1948. 


A set of tests for selection and placement 
in business and industry, prepared in uniform 
format. Each test contains about 50 items. 
Batteries are recommended for job-families, 
as, for example, perception, office terms and 
numbers for clerical personnel, and dimension, 
tools, precision and motor (an apparatus test) 
for mechanical employees. Some tests (e.g. 
perception) are primarily speed tests; others 
are largely power tests as shown by the rela- 
tionships between number right and number 
attempted. Kuder-Richardson reliabilities are 
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reported to “range above .88,” a few retest re- 
liabilities are found to be in the .80’s. No data 
on validity are given in the manual, but figures 
supplied by the author indicate some differen- 
tiations between jobs in a hierarchy, and be- 
tween employees rated as successful and un- 
successful. No original factor analysis with 
these tests was carried out in their construc- 
tion, but use was made of the implications of 
studies by Thurstone, Guilford and others. The 
intercorrelations of the tests in the series are 
reported to be low. With their attractive for- 
mats and ingenious conveniences of adminis- 
tration and scoring, these tests will appeal to 
industrial clients. A critical evaluation, how- 
ever, must await additional evidence of their 
validity. 


Kuper, G. Freperic. Kuder Preference Record 
—Personal. High school-adult. 1 form. Pin- 
punch scoring: booklet (48¢); answer pads 
($2.10 per 25). IBM scoring: booklet (35¢) ; 
answer sheets ($2.35 per 100); scoring sten- 
cils ($4.00). Profiles, boy/girl or adult (50¢ 
per 25); preliminary manual, pp. 4, (10¢); 
specimen set (75¢). Chicago: Science Re- 
search Associates, 1948. 


A new set of preference scales, dealing with 
five personal attitudes or values: sociable, 
practical, theoretical, agreeable, and dominant. 
The preliminary manual gives a brief account 
of an extended research program in the de- 
velopment and construction of the scales. 
Items were selected for high internal consis- 
tency, for low intercorrelations between scales 
(—.26 to +.32 in the final form), and for low 
correlation with the scales of the Kuder Pref- 
erence Record—Vocational. There is a verifi- 
cation score to detect careless answering; items 
for a falsification (“fake-good”) score are in- 
cluded but the latter scale is not yet published 
pending further research. The relatively low 
reliabilities of the five main scales, .84 to .86, 
lead the author to recommend caution in inter- 
pretation. Preliminary norms are based on 
1,302 adult men and 300 adult women, obtained 
by mail, and on 306 boys and 339 girls in high 
schools. A wide use may be predicted for this 
convenient and soundly-developed question- 
naire. 


Kuper, G. FREDERIC. Kuder Preference Record 
— Vocational. High school-adult. 1 new 
form, Form C. Untimed (40-50) min. Pin- 
punch scoring: booklet (48¢); answer pads 
$2.00 per 25). IBM scoring: booklet (35¢; 


answer sheets $2.90 per 100); scoring keys 
($7.50). Profiles, boy/girl or adult (50¢ per 
25); manual (25¢); specimen set (75¢). 
Chicago: Science Research Associates, 1948. 


Form C of the well-known Kuder blank has 
been retitled to distinguish it from the new 
“personal” questionnaire (see above). Its use- 
fulness has been extended by the addition of 
a new “outdoor” scale to the original nine: 
mechanical, computational, scientific, persua- 
sive, artistic, literary, musical, social service, 
and clerical. An added Verification Score de- 
tects examinees who have answered carelessly 
or failed to follow directions. A fully revised 
manual is in preparation; meanwhile, a sup- 
plementary instruction sheet gives a list of 
suggested occupations involving the “outdoor” 
preference. 


LIKERT, RENNIS AND QUASHA, WILLIAM H. Re- 
vised Minnesota Paper Form Board Test, 
1948 Manual. Revised manual, pp. 16, (25¢). 
New York: Psychological Corporation, 1948. 


The new manual for the MPFB Test consoli- 
dates the instructions for the hand- and ma- 
chine-scoring forms, gives extensive revised 
norms based on the now-recommended time 
limit of 20 minutes in place of various time 
limits used earlier, and includes an extensive 
discussion of validation studies. There is a 
bibliography of 54 entries. 


SYMONDS, PERCIVAL M. Symonds Picture-Story 
Test. Adolescents, Individual test. Long (20 
pictures) or short (10 pictures) form. Un- 
timed (60-120) min. 20 plates; manual, pp. 
20, ($5.25). New York: Bureau of Publi- 
cations, Teachers College, Columbia Univ., 
1948. 


After ten years of preparation, the materials 
for this projective test for adolescent boys and 
girls are made available for general use. The 
pictures, selected from among 42 drawn espe- 
cially for the test and used in preliminary ex- 
periments, represent adolescent boys and girls 
in various suggested social relationships: 
alone, with peer-figures and parent-figures of 
the same and of the opposite sex, in situations 
suggesting acceptanee, rejection, cu:npetition, 
and contrast of characters. The 20 plates are 
divided into two sets, A and B. For the longer 
form, set A is given first; for the shorter, only 
set B is used. The manual describes the ad- 
ministration, and gives a brief account of the 
analysis of the content in terms of the hero, 
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psychological forces (hostility, love, ambiva- 
lence, punishment, etc), relationships, atti- 
tudes, and outcomes. Although norms are not 
particularly pertinent to this type of techni- 
que, a table giving the frequencies of the prin- 
cipal themes is provided. A book giving a full- 
er account of the use and interpretation of the 
test is announced as in press. 


VAN LENNEP, D. J. Four Picture Test. Ado- 
lescent-adult. Individual test. 1 form. Un- 
timed, (15) min. 4 plates; manual, pp. 48; 
record blanks (Guilders 65.—, approximate- 
ly $25.00). The Hague, Netherlands: Marti- 
nus Nijhoff, 1948. 


Van Lennep’s Four Picture Test offers a 
variation from usual projective methods in 
that the four pictures are presented to the 
examinee together rather than serially. The 
subject’s task is to make up a story that com- 
bines all four pictures and brings them into 
relation with each other. He may choose any 
order in which the pictures are to appear. 
The pictures are vague, and resemble water- 
colors in quality. They include: I, two men 


on opposite sides of a table, the standing 
man pointing at the seated one (being with 
one other person); II, a vague figure in 
bed (being personally alone); III, a figure 
leaning against a lamp-post in the rain 
(being socially alone); IV, two men and 
two women in the foreground, watching 
tennis players (being with many others in a 
group). Originally devised in 1930, the test 
has been used on over 20,000 subjects in The 
Netherlands. The 48-page manual describes 
the administration of the test and the inter- 
pretation of protocols. Both formal qualities 
and content are used in the analysis of stories. 
Formal analysis involves the examinee’s use 
of each picture as to extent, quality and ac- 
tion. Content analysis is more like the familiar 
TAT, including identification, principal figure, 
time and space qualities, atmosphere, conflicts, 
themes, and objects. The manual gives four il- 
lustrative case studies. Although the Four Pic- 
ture Test is not likely to replace existing pro- 
jective methods, its originality of approach 
and economy of administration will undoubt- 
edly cause many American workers to try it 
as a supplementary device. 








ABNORMAL PSYCHOLOGY 


‘A Clinical Approach to Paychological Deviant 


By James D. Pace, Temple University, McCro.-Hill Publications in Paychol- 
ogy. 450 pages, $4.00. 


A well-balanced text dealing with personality misfits in society, designed for stu- 
dents with a limited background in psycho!o; The book summarizes present 
knowledge concerning the causes, symptoms, atment, and outcome of psaycho- 
neuroses, psychoses, mezta] deficiencies, and i-social personalities, Among 
the outstanding features are the 13-page glos and the list of visual-aids — 
motion pictures and filmstrips—correlated » he material in the text. 


PHYSIOLOGICAL PSYCHOLOGY 


By Citrrorp T. MorcaAN, Associate in Psycho! Johns Hopkins University, for- 
merly Faculty Instructor in Psychology, Harvar: University. McGraw-Hill Pub- 
lications in Paychology. 623 pages, 6 x 9, 176 strations. $4.50. 








After a historical introduction and a review of the basic facts of physiology 
and the nervous system, the book gives an « ded treatment of the physiologi- 
cal basis of psychological development, sen nd motor phenomena, motiva- 
tion, and learning and the higher thought ses, 





MODERN CLINICAL PSYCHOLOGY 


By T. W. RicHAxps, Professor of Psycholog) thwestern University, McGraw- 
Hul Publications in Psychology. 331 pages, ', $3.50. 


Integrates material from various fields such as abnormal psychology and psychi- 
atry, modern testing procedures, current ps iynamie principles regarding na- 
ture of personality and adjustinent with sup; ntary case material. This inte- 
gration is presented so that the reader ma principles illustrated in the per- 
formance of patients with psychological t terials, 


Send for copies on approval 
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